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Pre  face 


The  purpose  of  this  research  was  to  design  and  test  a 
computer  system  to  tutor  signal  analysts  on  radar  concepts. 
Based  on  artificial  intelligence  techniques,  this 
Intelligent  Computer  Aided  Instruction  (ICAI)  system  would 
assume  some  of  the  tasks  of  a  human  instructor.  Although 
the  design  has  been  tested,  much  work  remains  before  it  can 
be  used  in  an  actual  training  environment.  I  hope  this 
study  will  serve  as  the  basis  for  additional  research. 

Without  the  help  of  several  people,  this  endeavor  would 
never  have  been  completed.  I  would  like  to  express  my 
appreciation  to  Dave  Hostler,  Bill  Kovacs,  and  Greg  Stine 
from  the  Foreign  Technology  Division  for  suggesting  and 
supporting  this  thesis.  I  thank  Major  Parnell,  my  faculty 
advisor,  for  his  patient  guidance  during  this  project.  I  am 
also  grateful  to  my  readers,  Maj  Steve  Cross  and  Capt  Bob 
Hebert,  who  made  numerous  helpful  suggestions.  In  addition 
to  being  a  reader,  Capt  Hebert  provided  invaluable 
assistance  with  the  computer  system  at  the  Artificial 
Intelligence  Laboratory.  Finally,  I  want  to  thank  a  group 
of  special  friends  for  their  support  while  I  was  at  AFIT. 
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Abstract 


Intelligent  Computer  Aided  Instruction  (ICAI)  allows  a 
computer  to  perform  some  of  the  functions  normally  performed 
by  a  human  instructor.  This  thesis  describes  the  design  and 
implementation  of  an  ICAI  system  which  presents  radar 
principles  to  a  student,  tests  him,  finds  out  why  he  made  an 
error,  and  then  corrects  the  error. 

To  allow  the  system  to  be  used  for  different  subject 
domains,  the  knowledge  required  to  teach  was  kept  separate 
from  the  knowledge  about  the  subject  domain.  During  the 
design  phase,  the  knowledge  about  teaching  was  partitioned 
into  eight  knowledge  bases,  the  functions  of  these  knowledge 
bases  were  described,  and  their  interactions  with  one 
another  were  shown.  During  the  implementation  phase,  each 
knowledge  base  was  developed  separately  before  being 
integrated  into  the  system.  Of  these  eight  knowledge  bases, 
the  knowledge  base  which  tests  the  student  received  the 
major  emphasis.  This  knowledge  base  generates  a  multiple 
choice  question,  finds  the  answer,  and  creates  plausible 
incorrect  answers  to  serve  as  distractors.  Although  the 
radar  range  equation  was  used  to  test  this  knowledge  base, 
this  knowledge  base  performs  the  same  functions  with  any 
equation  which  is  entered  into  the  system  in  its  canonical 
form. 

Although  this  thesis  establishes  the  framework  for  an 
ICAI  system  and  then  demonstrates  its  feasibility,  further 
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I .  Introduct ion 


Background 

An  organization,  such  as  the  Air  Force,  is  faced  with 
conflicting  goals.  Since  it  cannot  meet  them  all,  it  must 
decide  which  goals  are  less  important  and  sacrifice  them,  or 
it  must  find  new  ways  of  meeting  them.  An  example  of 
conflicting  goals  is  the  Air  Force's  need  to  expose  future 
leaders  to  a  variety  of  jobs,  while  at  the  same  time 
insuring  that  its  people  have  the  expertise  to  accomplish 
the  mission.  This  conflict  is  resolved  through  training 
programs.  Whether  this  is  formal  training  or  on-the-job 
training  (OJT),  scarce  resources  of  people,  money,  and  time 
are  used. 


Since 

the  Air 

Force 

wants  to 

prov ide 

qual i ty 

instruction. 

its  OJT 

instructors  are 

usual  1  y 

its  most 

experienced 

people , 

i .  e  . , 

the  experts 

(Stuart  et  al , 

1984: 15). 

However,  several 

disadvantages 

result 

from  using 

experts  as 

instructors . 

First,  when  the 

expert  is 

Instructing, 

he  is  not 

performing  his  primary  job 

.  Second, 

for  the  expert  to  be  a  good  instructor  requires  that,  in 
addition  to  being  an  expert  at  his  primary  job,  he  needs  the 
skills  to  communicate  the  subject  material  to  the  student, 
diagnose  why  the  student  is  having  problems,  decide  how  to 
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Figure  1.1  Cost  of  People  Versus  Computers 

correct  these  problems,  and  then  correct  them.  Because  of 
the  difference  in  the  level  of  knowledge  between  the  expert 
and  the  student,  the  expert  may  not  understand  why  the 
student  does  not  understand  a  concept  which  the  expert 
thinks  is  obvious.  Assuming  the  expert  is  a  good 
instructor,  when  he  is  leaves  the  organization,  it  no  longer 
benefits  from  his  teaching  skills.  Even  without  these 
disadvantages,  there  a  continuing  demand  for  manpower  and 
money  to  train  people. 

One  way  to  more  effectively  use  experienced  people  is 
by  allowing  the  computer  to  perform  some  of  this  training 
(Freedman  and  Rosenking,  1986:31).  As  shown  in  Figure  1.1, 
the  cost  for  personnel  is  increasing  while  computers  are 
becoming  less  expensive  and  more  capable.  Although  there  is 
an  initial  cost  for  the  computer  and  its  associated 
software,  and  there  is  the  continuing  cost  for  maintenance 
on  the  system,  computer  aided  instruction  offers  several 
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advantages.  These  benefits  remedy  the  previous 

disadvantages  by  allowing  experienced  personnel  to  devote 
|  less  time  to  training  and  more  time  to  handling  complex 

problems  in  their  area  of  expertise,  by  consistently  using 
proven  methods  for  presenting  material,  and  finally,  by 
remaining  in  the  organization  indefinitely. 

An  organization  which  uses  its  experienced  personnel  as 
OJT  instructors  is  the  signal  analysis  branch  of  the  Foreign 
'  Technology  Division  (FTD>.  When  a  person  is  assigned  to 

FTD,  he  may  have  some  background  in  electronics  but  little 
knowledge  of  radars  and  how  to  analyze  radar  signals.  Since 
newly  assigned  personnel  are  trained  locally  by  the 
experienced  analysts,  these  analysts  must  divide  their  time 
between  instructing  and  analyzing  signals. 

Compounding  this  problem  is  the  relatively  short  time 
that  a  newly  trained  signal  analyst  remains  with  the 
organization  before  he  is  reassigned  (Kovacs,  1985).  The 
time  for  a  person  to  begin  training  until  he  is  qualified  to 
analyze  signals  may  take  up  to  a  year.  However,  once  he  has 
been  fully  trained,  he  will  generally  work  as  a  signal 
analyst  from  between  six  months  to  two  years  before  being 
reassigned.  And  then  his  replacement  must  be  trained. 

Problem  Definition 

Before  a  person  can  perform  most  Air  Force  jobs,  he 
must  possess  some  basic  skills.  However,  the  person 
providing  this  OJT  training  is  usually  the  one  with  the  most 
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experience;  this  is  the  person  whose  time  the  organization 
can  least  afford  to  lose.  Since  a  person  rarely  remains  in 
the  same  job  longer  than  a  few  years  and  a  large  portion  of 
this  time  may  be  spent  in  training,  the  use  of  the  expert  as 
an  instructor  causes  a  continuing  drain  on  the 
organization's  resources. 

Thesis  Objectives  and  Approach 

The  goal  of  this  thesis  is  to  develop  a  generic  design 
for  an  intelligent  computer  aided  instruction  (ICAI)  system 
capable  of  instructing,  testing,  and  tutoring  students  on 
radar  concepts.  The  design  for  the  Signal  Analyst  Tutoring 
System  (SATS)  serves  as  the  basis  for  further  development. 
To  permit  maximum  flexibility,  the  different  functions  of 
SATS  are  divided  into  individual  knowledge  bases.  Prototype 
software  is  developed  to  test  the  feasibility  of  the  design. 
Emphasis  is  given  to  different  ways  of  representing 
knowledge  to  permit  the  computer  to  generate  questions  and 
answers  for  the  material.  This  knowledge  base  is 
incorporated  into  the  skeletal  tutoring  system  and  its 
capability  is  evaluated. 

Scope 

Due  to  the  complexity  of  ICAI  systems,  most  research 
focuses  on  only  one  aspect  of  a  fully  developed  system  (Barr 
and  Feigenbaum,  1982:229).  This  is  true  for  this  effort. 
Although  the  system  design  is  for  a  full  tutoring  system, 
many  of  the  knowledge  bases  are  developed  only  enough  for 
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the  design  to  be  evaluated.  As  a  result, 
development  of  the  current  prototype  software  does  not  allow 
it  to  be  used  for  training. 

Although  SATS  benefits  from  several  capabilities 
offered  by  the  M.l  expert  system  building  tool,  it  also 
suffers  from  some  of  its  limitations.  Since  the  user 
interface  is  restricted  to  menus,  the  questions  generated  by 
the  tutoring  system  is  limited  to  a  multiple  choice  format. 

The  purpose  of  this  thesis  is  to  develop  c.  tutoring 
system  rather  than  actual  instructional  material. 
Therefore,  the  lesson  material  used  to  test  SATS  comes  from 
training  materials  (National  Security  Agency,  1981), 
textbooks  (Skolnick,  1980;  Stimson,  1983),  and  interviews 
(Stine,  1986).  No  attempt  is  made  to  use  educational 
psychology  for  diagnosing  and  correcting  the  student's 
errors . 

Assumptions 

The  primary  assumptions  involve  the  student.  Since 
SATS  is  used  to  teach  the  more  Important  concepts,  it  is 
assumed  the  student  has  read  the  assigned  material  about 
radars  before  using  SATS.  When  answering  questions,  the 
student  is  expected  to  answer  the  questions  to  the  best  of 
his  ability  rather  than  making  incorrect  responses  due  to 
boredom,  curiosity,  or  inattention. 

The  reader  of  this  thesis  is  assumed  to  have  a  basic 
understanding  of  such  artificial  intelligence  concepts  as 
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knowledge  bases  and  inference  engines.  The  interested 
reader  can  find  additional  information  in  the  Handbook  of 
Artificial  Intelligence,  Harmon  and  King's  Expert  Systems, 
and  Waterman's  A  Guide  to  Expert  Systems. 

Equ ipment 

SATS  was  developed  on  an  IBM-AT  in  the  Artificial 
Intelligence  Laboratory  using  version  2.0  of  the  M.l  expert 
system  building  tool. 

Overv iew 

Chapter  Two  describes  ICAI  and  recent  research  in  this 
area.  The  third  chapter  covers  expert  system  building  tools 
and  the  different  layers  of  knowledge  in  the  tutoring 
system.  The  fourth  chapter  concentrates  on  the  different 
knowledge  bases  and  their  interaction.  Chapter  Five 
describes  the  prototype  tutoring  system  developed  for  this 
thesis.  Chapter  Six  summarizes  the  research  and  makes 
recommendations  for  further  work. 


I I .  Summary  of  Related  Work 

Introduct  ion 

Artificial  intelligence  allows  computers  to  perform 
functions  generally  carried  out  by  humans.  These  functions 
can  be  broken  into  natural  language ,  robotics,  and  expert 
systems  (Harmon  and  King,  1985:4-5).  An  expert  system  is  ’a 
computer  program  using  expert  knowledge  to  attain  high 
levels  of  performance  in  a  narrow  problem  area."  (Waterman, 
1986:11).  The  techniques  used  to  build  an  expert  system  may 
be  used  to  create  programs  which  solve  problems  not 
requiring  an  expert;  these  are  known  as  knowledge  systems. 
As  experience  with  knowledge  systems  grows,  additional  areas 
for  application  have  also  increased.  One  of  these  areas  is 
intelligent  computer  aided  Instruction  (ICAI)  systems.  This 
chapter  introduces  ICAI  systems  by  looking  at  the  three 
components  into  which  an  ICAI  system  may  be  divided  and  then 
describing  some  representative  ICAI  systems.  These  systems 
vary  in  approach,  complexity,  and  subject  area. 

Components  of  an  ICAI  System 

The  goal  of  an  ICAI  system  is  to  assume  some  of  the 
duties  of  an  instructor.  ICAI  systems  can  be  broken  into 
three  components:  problem-solving  expertise,  student  model, 
and  tutoring  strategies  (Barr  and  Feigenbaum,  1982:229). 
Current  research  in  ICAI  systems  usually  addresses  only  one 
of  these  areas. 
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The  expertise  forms  the  basis  of  student  Instruction. 
The  for*  of  expertise  used  depends  on  the  subject  area  as 


well  as  the  type  of  Instruction  to  be  accomplished.  If  the 
goal  Is  to  teach  the  student  to  perform  a  task  properly,  the 
task  Is  often  solved  by  an  expert  system  or  a  simulator,  and 
the  student's  answer  is  compared  to  that  of  the  expert 
system.  Another  type  of  expertise  is  to  simply  present 
Information.  The  fora  of  the  information  must  allow  the 
tutoring  system  to  reason  over  the  Information  to  generate 
questions  and  answers. 

The  student  model  contains  "any  information  which  a 
teaching  program  has  which  Is  specific  to  the  particular 
student  being  taught*  (O'Shea  and  Self,  1983:143).  Two 
types  of  student  models  are  the  overlay  model  and  the 
perturbation  model  (Sleeman  and  Brown,  1982:4).  The  overlay 
model,  sometimes  called  a  differential  model,  assumes  that 
the  student's  knowledge  is  correct  but  Is  a  subset  of  the 
expert's  knowledge;  the  emphasis  is  placed  on  how  they 
differ.  The  perturbation  model  represents  the  student's 
knowledge  as  not  only  less  than  the  expert's  knowledge  but 
with  mis-learned  subskills. 

The  tutoring  module  determines  how  to  teach  the 
student.  Ideally,  the  tutoring  module  considers  both  the  • 
student  model  and  the  instructional  objectives.  Some  of  the 
tutoring  module's  duties  include  what  material  to  present, 
at  what  level  to  present  it,  and  when  and  how  to  correct  the 
student.  One  teaching  style  uses  the  Socratic  method  of 
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asking  the  student  questions  and  letting  him  learn  from  his 


i 

1 

«• 


answers.  Another  teaching  style,  coaching.  Is  accomplished 
by  watching  the  student  perform  some  activity  and  correcting 
him  when  he  makes  errors.  If,  however,  the  expert  system 
solves  the  problem  using  methods  other  than  those  used  by  a 
human,  the  student  may  need  to  be  tutored  by  a  second  less 
efficient  but  more  articulate  expert  (Burton  and  Brown, 
1982:82). 


Generative  Computer  Aided  Instruction 

When  the  goal  of  ICAI  is  to  provide  Information  rather 
than  teach  a  skill,  a  generative  form  of  ICAI  is  used.  In 
these  systems,  knowledge  about  the  subject  domain  must  be 
represented  In  a  form  that  allows  the  system  to  reason  over 
It  and  then  generate  questions  and  answers. 

SCHOLAR .  One  such  system,  SCHOLAR  (Carbonell,  1970; 
Gable  and  Page,  1980:265-267)  teaches  a  student  about  the 
geography  of  South  America.  The  knowledge  about  South 
American  geography  Is  represented  in  a  semantic  network. 
Facts,  such  as  the  location,  size,  climate,  etc.  of  a 
country,  form  the  nodes  of  the  network  and  their 
relationships  form  the  arcs  between  the  nodes.  An  example 
of  such  a  network  is  shown  In  Figure  2.1.  SCHOLAR  also  uses 
the  semantic  network  as  a  simple  student  model;  it  assumes 
that  the  student  knows  the  material  until  proven  otherwise. 
The  system  uses  the  Socratlc  method  of  teaching  by  asking 
the  student  questions.  It  also  answers  questions  which  the 


II  -  3 


Figure  2.1  Semantic  Network  for  SCHOLAR 


student  asks  about  South  American  geography.  Since  the 
teaching  knowledge  and  the  subject  knowledge  are  separate, 
it  is  relatively  easy  to  change  the  subject  domain  from 
South  American  geography  to  African  geography  by  changing- 
part  of  the  semantic  network.  A  more  substantive  change, 
such  as  changing  the  subject  domain  from  South  American 
geography  to  anatomy,  requires  more  extensive  changes  to  the 
semantic  network.  Even  in  this  case,  the  teaching  knowledge 
in  the  program  remains  relatively  stable.  (Carbonell, 
1970:191).  This  stability  was  demonstrated  by  building  WHY, 
a  similar  system,  which  teaches  students  about  the  causes  of 
rain  (Stevens  et  al,  1982;  Roberts  and  Ok-choon,  1983:8). 

Task-Oriented  Computer  Aided  Instruction 


While  SCHOLAR  uses  the  generative  form,  most  tutoring 
systems  teach  a  student  a  skill  by  letting  him  perform  a 
task,  monitoring  his  actions,  and  then  correcting  his 


errors.  This  model  of  teaching  behavior  Is  known  as  task- 
oriented  ICAI . 

BUGGY .  It  Is  much  easier  for  a  tutor,  whether  a  person 
or  a  computer,  to  detect  a  student  error  than  to  diagnose 
the  cause  of  error.  Brown  and  Burton  designed  BUGGY  to 
diagnose  systematic  errors  using  place-value  subtraction  as 
the  subject  domain.  After  breaking  subtraction  skills  into 
subskills,  the  researchers  found  ways  these  subskills  could 
be  applied  to  get  the  wrong  answer;  eventually,  110 
primitive  bugs  were  found.  By  inserting  each  bug  into  the 
correct  procedure  until  the  system's  solution  matches  that 
of  the  student,  a  possible  cause  for  the  error  can  be  found. 
However,  the  diagnosis  is  complicated  when  more  than  one 
type  of  bug  can  cause  the  same  wrong  answer,  when  several 
primitive  bugs  form  a  compound  bug,  or  when  the  student's 
behavior  is  inconsistent  (Burton,  1982:162,164).  Proper 
design  of  test  problems  is  critical  in  detecting  compound 
bugs.  One  such  test  distinguishes  among  1200  compound  bugs 
with  only  twelve  problems  (Burton,  1982:172).  The  program 
is  interactive,  giving  the  student  additional  problems  when 
a  student  error  is  identified.  Once  the  diagnostic  tests 
are  complete,  the  diagnosis  forms  a  student  model;  it  can 
predict  not  only  which  future  problems  he  will  answer 
incorrectly  but  also  his  answers  (Burton,  1982:160).  BUGGY 
has  also  been  used  to  train  teachers  to  diagnose  errors  by 
solving  problems  with  various  bugs  and  requiring  the 
teachers  to  detect  the  bug  (Barr  and  Feigenbaum,  1982:2 81). 


MACSYMA  Advisor.  Whereas  BUGGY  finds  the  reason  a 
student  makes  an  error  by  evaluating  only  answers,  more 
complicated  problems  require  more  information.  The  steps 
which  the  student  takes  in  arriving  at  his  answer  are  also 
needed.  The  MACSYMA  Advisor  attempts  to  solve  this  problem. 

MACSYMA  is  an  interactive  computer  program  which  helps 
scientists,  mathematicians,  and  engineers  solve  mathematical 
problems  (Genesereth,  198?: 138).  Because  of  its  size  and 
versatility,  some  users  are  unfamiliar  with  many  of  its 
features.  The  MACSYMA  Advisor  was  developed  to  aid  these 
users.  The  expertise  in  the  MACSYMA  Advisor  is  separate 
from  MACSYMA;  it  has  its  own  knowledge  base  for  deducing 
the  problem  solving  approach  which  the  student  is  using, 
finding  which  part  is  Incorrect,  discovering  why  it  is 
wrong,  and  then  recommending  the  correct  approach. 

Although  a  particular  procedure  may  be  correct,  it  may 
be  used  at  the  wrong  time  or  may  not  be  appropriate  for  the 
problem.  For  instance,  if  the  student  is  to  solve  the 
problem  X  =  2  +  3  *  4  he  may  perform  the  addition  before 
the  multiplication  and  decide  that  X  *  20.  Even  though  he 
added  and  multiplied  correctly,  he  did  it  in  the  wrong 
sequence.  By  starting  with  the  user's  overall  goal  and  the 
sequence  the  student  uses  to  reach  his  goal,  the  Advisor 
tries  to  find  which  planning  methods  would  have  resulted  in 
the  student  making  the  inputs  he  did.  For  example,  if  the 
overall  goal  is  to  find  the  root  of  a  quadratic  equation, 
the  Advisor  determines  the  different  ways  of  accomplishing 


this  (e.g.,  finding  the  root  by  the  quadratic  formula  or 
finding  the  root  through  factoring).  These  methods  continue 
to  be  broken  into  sub-problems  until  they  reach  the  point 
where  the  student  needs  to  make  an  input.  The  Advisor 
compares  the  inputs  required  for  each  of  these  methods  with 
the  Inputs  actually  made  by  the  student  to  deduce  which 
method  he  used.  If  there  are  several  plans  which  the 
student  may  have  used,  the  Advisor  asks  the  student  about 
the  mathematical  principles  necessary  for  each  plan.  From 
the  student's  answers,  the  Advisor  determines  which 
principle  the  student  needs  tutoring.  Rather  than  using  the 
Socratic  method  for  correcting  the  student's  error,  the 
Advisor  simply  tells  him  where  he  is  wrong  and  suggests  the 
proper  operation.  Although  several  approaches  may  be  used 
to  solve  a  particular  problem,  the  Advisor  recommends  the 
approach  that  most  closely  follows  the  student's  original 
approach. 

SOPHIE.  The  previously  described  tutoring  systems 
Instruct  rather  than  encourage  the  student  to  try  out  his 
own  ideas.  SOPHIE,  an  ICAI  system  designed  to  teach 
students  techniques  for  electronic-troubleshooting,  provides 
an  experiential  learning  environment  where  the  student  can 
learn  from  his  mistakes  (Brown,  1982:229).  Although  SOPHIE 
has  evolved  through  three  systems,  this  discussion  focuses 
on  SOPHIE  III. 

While  SOPHIE  I  and  II  use  the  general-purpose 
electronic  simulator  SPICE  to  simulate  a  faulted  circuit. 


SOPHIE  III  allows  the  student  to  make  measurements  on  an 
actual  circuit.  SOPHIE  III  consists  of  an  electronics 
expert  which  reasons  about  electrical  circuits,  a 
troubleshooter  which  is  concerned  with  measurements  made  on 
the  circuit,  and  a  coach  which  decides  when  to  instruct  the 
student.  To  give  the  electronics  expert  maximum  generality, 
its  designers  used  large  amounts  of  general  electronics 
information  in  its  knowledge  base;  it  uses  this  information 
to  deduce  the  voltages  and  currents  from  measurements  made 
by  the  student.  The  general  electronics  information  is 
supplemented  with  circuit-specific  information  to  inform  the 
system  about  the  circuit.  During  a  consultation,  the 
student  tells  SOPHIE  the  results  of  a  measurement.  As  the 
student  makes  more  measurements,  the  electronics  expert  uses 
the  general  electronics  laws  to  find  the  voltages  and 
currents  experienced  throughout  the  circuit  for  the 
measurements  to  be  true.  As  the  electronics  expert 
continues  this  process,  it  eventually  finds  a  contradiction 
between  what  is  measured  in  the  faulted  circuit  and  what 
should  be  measured  on  its  model  of  a  good  circuit.  The 
troubleshooter  then  uses  this  contradiction  to  narrow  the 
choice  of  possible  faults.  Since  a  major  part  of  skillful 
troubleshooting  is  knowing  which  measurement  to  make,  the 
troubleshooter  evaluates  the  quality  of  the  decision  as  to 
how  efficiently  it  reduces  the  number  of  components 
suspected  of  being  bad.  The  troubleshooter  uses  this 
criterion  to  evaluate  the  quality  of  a  student's  choice.  It 


i 

also  uses  this  criterion  to  suggest  which  measurement  should 

1 

be  done  next  but  only  if  asked  to  do  so  by  the  student.  In 
addition  to  monitoring  and  commenting  on  the  student's 
actions,  the  troubleshooter  can  explain  Its  actions  to  the 
student  as  it  troubleshoots  a  circuit.  Finally,  the  coach 
^  decides  when  to  instruct  the  student.  For  instance,  if  the 

student  takes  measurements  which  can  be  found  from  earlier 
measurements,  it  asks  him  some  questions  to  see  if  the 
student  recognizes  this  redundancy. 

GUIDON.  Since  an  expert  system  performs  a  task  well,  a 
student  should  gain  experience  by  observing  it  operate. 
However,  it  was  discovered  that  the  structure  of  these 
expert  systems  do  not  permit  them  to  effectively  instruct. 
GUIDON  Is  an  ICAI  system  which  uses  the  knowledge  from  the 
expert  system  MYCIN  to  teach  medical  students. 

MYCIN  is  a  medical  expert  system  which  provides  advice 
about  antimicrobial  therapy  for  bacteremia  and  meningitis 
(Harmon  and  King,  1985:15).  It  acts  like  a  consultant  to  a 
physician  by  asking  him  questions  about  a  patient, 
diagnosing  the  patient's  problem,  and  prescribing  drugs  to 
combat  this  problem.  Like  many  expert  systems,  MYCIN  is  a 
production  system  based  on  a  series  of  rules;  the  IF 
clauses,  l.e.,  propositions,  of  the  rule  specify  when  the 
rule  should  be  applied,  and  the  THEN  fact  Indicates  the  fact 
that  is  true  if  the  rule  is  applied  (Rich,  1983:31).  Shown 
below  is  a  sample  production  rule  from  MYCIN  (Clancey, 
1982:203) . 
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IF  (1)  the  gram  stain  of  the  organism 
Is  gram  negative,  and 
<2)  the  morphology  of  the  organism 
is  rod,  and 

(3)  the  aerobicity  of  the  organism 
is  anaerobic, 

THEN  there  is  suggestive  evidence 
(0.6)  that  the  genus  of  the 
organism  is  Bacteroides. 

It  was  felt  that,  because  of  the  expert  knowledge  in 
this  system,  it  could  be  used  to  train  medical  students  to 
diagnose  and  treat  bacteremia  and  meningitis  by  presenting 
cases  already  solved  by  MYCIN.  However,  Clancey  found  that, 
although  the  production  rules  used  in  MYCIN  can  inform  the 
user  why  the  system  does  something,  much  of  the  information 
used  by  the  expert  system  is  implicit  rather  than  explicit. 
That  .w,  an  experienced  person  can  understand  why  the  system 
does  something  while  a  student  does  not.  GUIDON  was 
developed  to  overcome  these  limitations  by  actively 
determining  what  the  student  really  knows,  presenting  the 
information  in  an  organized  manner,  and  then  explaining  the 
expert's  reasoning  (Clancey,  1982:202). 

GUIDON  is  a  "case-method"  tutor  which  leads  a  student 
through  a  case  already  solved  by  MYCIN.  When  MYCIN 
originally  solves  a  case,  it  forms  a  tree  of  the  goals  and 
rules  used  to  draw  conclusions.  This  tree  is  used  by  GUIDON 
to  find  what  conclusions  MYCIN  can  draw  based  on  the 
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information  available  to  the  student;  this  is  updated  as  the 
student  receives  more  information.  Using  this  tree  as  well 
as  information  on  the  student's  history  and  competence. 
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GUIDON  decides  which  of  the  conclusions  formed  by  MYCIN 
should  be  known  by  the  student. 


Both  discourse  procedures  and  tutoring  rules  are  used 
during  the  tutoring  session.  Discourse  procedures  tell 
GUIDON  what  it  should  do  under  certain  circumstances.  For 
instance,  GUIDON  starts  a  session  using  the  discourse 
procedure  CASE-DISCUSSION  which  first  selects  a  case  and 
then  gives  the  student  some  preliminary  information.  GUIDON 
uses  tutoring  rules  to  select  discourse  procedures,  choose 
domain  knowledge,  and  update  the  student  model  (Clancey, 
1982:210).  An  example  of  a  tutoring  rule  used  to  update  the 
student  model  is  shown  as  follows  (Clancey,  1982:220). 

IF  (1)  The  hypothesis  does  include  values  that 
can  be  concluded  by  this  domain  rule,  as 
well  as  others,  and 

(2)  The  hypothesis  does  not  include  values 
that  can  only  be  concluded  by  this  domain 
rule,  and 

(3)  Values  concluded  by  the  domain  rule  are 
missing  in  the  hypothesis 

THEN  Define  the  belief  that  the  domain  rule 
was  considered  to  be  -0.70. 

Summary 

Although  interest  in  computer  aided  instruction  has 
existed  for  several  decades,  most  of  the  advances  in  ICAI 
systems  have  occurred  within  the  last  ten  years  because  of 
Increased  processing  speeds  and  reduced  costs  for  computers. 
The  goal  of  an  ICAI  may  be  to  teach  the  student  how  to 
properly  perform  a  task  (task-oriented),  or  it's  goal  may  be 
to  present  him  with  information  about  the  subject  domain 
(generative).  The  next  chapter  gives  an  overview  of  SATS  by 
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When  an  individual  starts  working  as  a  signal  analyst, 
he  may  be  unfamiliar  with  radar  principles.  SATS  is 
designed  to  remedy  this  by  tutoring  these  individuals.  The 
design  of  SATS  focuses  on  separating  the  knowledge  about 
teaching  from  the  knowledge  about  the  subject  area.  The 
more  these  knowledge  sources  are  separated,  the  easier  it  is 
to  use  SATS  to  tutor  in  other  subject  areas.  This  chapter 
shows  how  the  knowledge  comprising  SATS  is  separated  into 
layers  and  then  describes  the  knowledge  in  each  layer. 
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Hierarchy  of  Knowledge 

Figure  3.1  shows  the  layers  which  form  the  hierarchy  of 
knowledge  for  SATS  as  a  software  pyramid.  Ascending  this 
pyramid  isolates  the  developer  from  the  particular  computer 
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used  and  allows  concentration  on  higher-level  knowledge. 
However,  when  one  selects  the  layer  on  which  to  develop  a 
knowledge-based  system,  he  must  consider  the  tradeoff 
between  the  amount  of  time  required  to  develop  the  system 
and  its  adaptability  to  meet  different  teaching 
requ lrements . 

Although  layers  are  isolated  from  one  another,  the 
lower  layers  constrain  the  form  of  the  higher  layers.  Since 
starting  near  the  bottom  of  the  pyramid  requires  that  all 
the  higher  layers  be  developed,  the  developer  is  free  to 
design  these  higher  layers  to  meet  the  requirements  of  the 
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Figure  3.1  Software  Pyramid 

system.  Thus,  flexibility  is  the  primary  advantage  of 
starting  near  the  bottom  of  the  pyramid.  However,  if  a 
system  has  already  been  developed  which  meets  most  of  the 
needs  of  the  new  system,  a  great  deal  of  development  time 
can  be  saved  by  adapting  the  original  system  to  meet  the 
needs  of  the  new  system.  SATS  starts  at  the  expert  system 
building  tool  layer  and  adds  three  more  layers  to  the 
pyramid,  thereby  offering  significant  time  savings  to  future 


Year  Begun 


Figure  3.2  Time  Required  to  Develop  Expert  Systems 

(Davis,  1982:10) 


tutoring  system  developers.  The  effort  required  to  change 
the  facts  about  the  specific  subject  domain  is  relatively 
minor,  but  the  knowledge  representation  strategy  at  this 
level  is  fixed. 

Expert  System  Tools 

"Expert  system  tools  are  programming  systems  that 
simplify  the  job  of  constructing  an  expert  system" 
(Waterman,  1985:80).  For  a  knowledge-based  system  to  be 
useful,  it  needs  an  inference  engine,  user  interface,  and 
explanation  capability.  As  shown  in  Figure  3.2, 
approximately  ten  years  were  required  to  encode  the 


knowledge  and  create  these  features  for  the  medical  expert 
system  MYCIN.  Later,  the  medical  knowledge  about  meningitis 


and  bacteremia  was  removed  from  MYCIN  to  create  the  expert 


system  tool  EMYCIN.  By  Inserting  medical  knowledge  about 
respiratory  diseases  into  EMYCIN,  the  expert  system  PUFF  was 
created  in  approximately  five  years.  In  exchange  for  the 
reduced  time  needed  to  prototype  a  new  expert  system,  the 
developer  must  either  insure  that  the  problem  solving 
paradigm  of  the  new  system  closely  matches  the  capabilities 
of  the  expert  system  tool  or  accept  the  constraints 
resulting  from  the  tool. 

Selecting  an  Environment 

Several  factors  were  considered  in  selecting  the 
programming  environment  for  SATS.  Since  this  thesis 
emphasizes  rapid  design  and  evaluation  of  a  tutoring  system, 
a  tool  rather  than  a  higher-order  language  was  chosen.  This 
allowed  the  effort  to  be  concentrated  on  the  problem  rather 
than  on  construction  of  an  inference  engine,  user  interface, 
and  explanation  capability.  Several  other  requirements 
further  narrowed  the  choice  of  tools  for  the  project:  (a) 
after  development  at  AFIT,  SATS  needed  to  be  transported  to 
FTD,  <b>  the  tool  should  permit  SATS  to  be  maintained  by 
someone  without  an  extensive  computer  background,  (c>  the 
tool  should  offer  features  to  help  the  knowledge  engineer 
during  system  development,  (d)  the  tutoring  system  should 
operate  fairly  quickly  to  minimize  the  amount  of  time  a 
student  spends  waiting  for  the  computer  to  decide  what  to  do 
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Of  the  tools  available,  the  M.l  expert  system  building 
tool  comes  closest  to  meeting  these  requirements.  The 
person  maintaining  the  system  can  learn  the  basic  features 
of  M.l  in  a  relatively  short  time  through  reading  its 
documentation,  examining  sample  knowledge  systems,  and 
attending  a  five-day  course  on  M.l  offered  as  part  of  the 
professional  continuing  education  course  at  the  AFIT 
Artificial  Intelligence  Laboratory.  He  can  then  maintain 
and  further  develop  the  system.  M.l  is  easily  transported. 
Once  a  knowledge  system  has  been  developed,  it  can  be  copied 
onto  a  floppy  disk  and  later  installed  on  another  IBM-PC. 
Since  many  Air  Force  organizations  have  an  IBM-PC  (or 
compatible)  computer,  support  should  not  be  a  problem.  M.l 
offers  a  relatively  sophisticated  Inference  engine  and  user 
interface.  Several  aids  are  also  available  to  the  knowledge 
engineer,  including  an  explanation  capability  and  other 
debugging  devices.  The  one  requirement  in  which  M.l  is 
marginal  is  speed  of  operation.  The  knowledge  engineer  can 
improve  its  operating  speed  by  properly  constructing  rules. 


Control  Rules 

As  shown  in  Figure  3.1,  control  rules  form  the  layer 
between  the  expert  system  building  tool  and  the  teaching 
principles.  These  control  rules  govern  the  order  and  the 


way  the  teaching  knowledge  bases  Interact  Independently  of 


Figure  3.3  Teaching  Process 


the  student  questions  and  evaluating  his  answers,  diagnosing 
why  he  misses  the  questions,  correcting  his  misconception, 
and  then  repeating  the  process.  Although  modifying  the 
control  rules  affects  the  layers  higher  in  the  pyramid, 
these  effects  are  minimized  because  the  rules  in  the  upper 
layers  are  separate  from  the  control  rules. 

Teaching  Principles 

The  knowledge  comprising  teaching  principles  is 
partitioned  into  eight  separate  knowledge  bases.  These 
knowledge  bases  accomplish  specific  teaching  functions  such 
as  testing  the  student,  diagnosing  the  cause  of  his  error, 
and  then  correcting  the  problem.  The  operations  of  the 
Individual  knowledge  bases  are  discussed  in  Chapter  Four. 
Dividing  the  teaching  functions  into  these  knowledge  bases 
allows  each  one  to  be  developed  and  tested  Independently 
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before  being  integrated  into  the  full  system.  This  also 
allows  an  individual  knowledge  base  to  be  modified  without 
affecting  the  other  knowledge  bases  as  long  as  the  form  of 
the  information  entering  and  coming  out  of  the  knowledge 
base  remains  the  same.  Attention  can  then  be  focused  where 
it  is  needed  -  on  the  knowledge  bases  most  affected  by  the 
modification.  The  effort  required  to  modify  SATS  depends  on 
the  type  of  change  made  and  the  number  of  knowledge  bases 
affected. 

Facts 

A  list  of  facts  comprises  the  knowledge  about  a 
specific  subject  domain.  Since  this  is  at  the  top  of  the 
pyramid  and  modifying  it  does  not  affect  the  lower  layers, 
it  can  be  easily  changed.  However,  the  knowledge 
representation  strategy  is  constrained  by  the  lower  layers 
in  the  pyramid.  To  change  the  system  at  this  layer 
basically  involves  substituting  new  facts  for  old  facts 
in  the  same  knowledge  representation  strategy. 

Summary 

A  computer  system  should  be  based  on  several  layers. 
In  selecting  the  layer  on  the  pyramid  at  which  to  start 
developing  the  system,  the  developer  must  consider  the 
tradeoff  between  speed  of  development  and  design 
flexibility.  By  starting  higher  in  the  pyramid,  the  system 
can  be  developed  more  quickly,  but  constraints  are  placed  on 
what  the  system  can  do  since  many  of  the  features  and 
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decisions  are  already  made.  SATS  adds  three  additional 
layers  to  the  hierarchical  pyramid  and  can  potentially  save 
a  developer  a  great  deal  of  time  in  developing  a  new 
tutoring  system.  Chapter  Four  describes  the  system  design 
for  SATS  by  identifying  the  individual  knowledge  bases 
within  these  layers,  discussing  the  type  of  knowledge  in 
these  knowledge  bases,  and  then  showing  how  they  interact. 


I V .  System  Design 
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SATS'  architecture  allows  the  knowledge  in  SATS  to  be 
partitioned  into  layers  and  the  knowledge  in  a  particular 
layer  to  be  further  divided  into  knowledge  bases.  SATS  is 
also  designed  to  follow  the  same  tutoring  process  used  by  an 
instructor.  While  the  previous  chapter  discussed  how  the 
knowledge  is  split  into  layers,  this  chapter  describes  the 
tutoring  process  used  by  SATS;  it  examines  the  functions  of 
the  individual  knowledge  bases  and  then  notes  their 
interaction  with  one  another.  After  describing  SATS* 
current  design,,  the  chapter  shows  how  SATS  may  be  modified 
to  perform  task-oriented  CAI  rather  than  generative  CAI . 
While  this  chapter  addresses  the  design  of  SATS,  Chapter 
Five  discusses  SATS  as  it  is  now  Implemented. 


Instruction  -  an  Expert  System  Application 

Knowledge-based  systems  can  be  classified  into 
categories  according  to  the  type  of  problem  they  solve.  One 
of  these  categories,  instruction,  is  a  composite  of  three 
other  categories:  diagnosing,  debugging,  and  repairing 

student  behavior  (Waterman,  1986:32-33).  To  be  effective, 
each  of  these  relies  on  the  student  model  to  reflect  an 
accurate  representation  of  the  student's  level  of  knowledge 
and  his  past  performance. 

Diagnosis.  A  general  definition  of  diagnosis  is  “the 


process  of  fault-finding  in  a  system 


based  on 
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Interpretation  of  potentially  noisy  data"  (Steflk  et  al, 
1982:137).  A  diagnosis  is  made  by  assessing  how  the  subject 


deviates  from  some  standard.  Difficulties  in  making  a 
correct  diagnosis  include  working  with  intermittent  faults, 
compound  faults,  and  Inaccessible  data.  As  applied  to 
tutoring,  an  Intermittent  fault  arises  from  inconsistent 
student  behavior  resulting  from  boredom  or  inattention.  A 
compound  fault  occurs  when  the  student  makes  several  errors 
in  arriving  at  his  answer.  Since  the  actual  reason  a 
student  makes  an  error  is  inaccessible  to  the  tutoring 
system,  it  must  diagnose  the  probable  cause  based  on 
symptoms . 

Debugging .  Knowledge-based  systems  in  the  debugging 
category  “prescribe  remedies  for  malfunctions"  (Waterman, 
1986:33).  In  the  context  of  a  tutoring  system,  debugging  is 
the  intermediate  step  between  diagnosis  and  repair.  While 
diagnosis  finds  out  why  the  student  makes  an  error, 
debugging  decides  how  to  correct  it.  In  selecting  a  plan 
for  correcting  the  error,  the  debugger  must  consider  the 
plan's  cost  and  availability.  The  plan  should  also 
accomodate  the  student's  current  knowledge  and  his  learning 
style . 

Repair.  The  last  category  involves  knowledge-based 
systems  which  repair  malfunctions  by  following  a  plan 
(Waterman,  1986:37).  Using  the  plan  created  during  the 
debugging  phase,  a  tutoring  system  repairs  the  student's 
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Figure  4.1  Heuristic  Classification 


behavior  until  it  matches  the  standard.  During  this  phase, 
care  must  be  taken  not  to  introduce  additional  student 
errors . 

Heuristic  Classification 

Using  these  three  instructional  categories,  there  are 
several  problem-solving  techniques  for  determining  the  best 
way  to  correct  the  student's  error.  Simple  classification 
merely  uses  one-to-one  mapping  between  an  error  and  its 
appropriate  correction  (Clancey,  1985:313).  A  knowledge- 
based  system  which  uses  heuristic  classification  more 
closely  follows  the  problem-solving  techniques  used  by 
experts  (Clancey,  1985:291).  In  heuristic  classification, 
a  particular  problem  is  placed  into  the  appropriate  error 
category,  heuristics  are  applied  to  identify  solutions  for 
problems  belonging  to  this  particular  category,  and  then  the 
solution  is  applied  to  the  particular  problem.  Figure  4.1 


shows  how  this  applies  to  a  tutoring  system  using  a  specific 


student  error  as  the  problem.  For  example,  the  student  may 
not  know  that  *c"  represents  the  speed  of  light.  This  error 
is  then  placed  into  its  appropriate  error  category.  Using 
heuristics,  or  rules  of  thumb,  a  decision  Is  made  concerning 
the  probable  cause  for  the  student  making  this  type  of 
error.  Other  heuristics  are  then  applied  to  determine  the 
best  way  to  correct  this  particular  type  of  error.  Finally, 
this  solution  category  is  applied  to  the  specific  error  and 
the  student  is  given  remedial  tutoring. 


SATS  -  System  Design 

Using  the  concepts  discussed  above,  SATS  leads  a 
student  through  a  series  of  lessons  on  radar  principles  by 
instructing  a  radar  concept  and  then  asking  some  questions. 
If  he  answers  correctly,  the  system  continues  instructing. 
However,  if  he  answers  incorrectly,  SATS  attempts  to 
determine  why  the  student  answered  incorrectly  and  then 
provides  remedial  tutoring.  After  correcting  the  problem, 
SATS  continues  leading  the  student  through  the  lesson. 


SATS  incorporates 

the 

three 

components 

of 

an  I CAI 

system 

discussed  in  Chapter 

Two; 

these 

are 

the 

problem- 

solving 

expertise,  the 

student  model. 

and 

the 

tutoring 

strategies.  In  keeping  with  SATS'  modular  design,  these  are 
further  divided  into  the  eight  knowledge  bases  <KB>  shown  in 
Figure  4.2.  These  knowledge  bases  contain  the  facts  and 
rules  used  by  an  instructor.  Included  in  the  problem¬ 
solving  expertise  component  are  the  Presentat ion-KB,  the 
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SIGNAL  ANALYST  TUTORING  SYSTEM  (SATS) 


COMPONENT  KNOWLEDGE  BASE _ FUNCTION 

PROBLEM-SOLVING  EXPERTISE: 
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QUESTION  GENERATOR 
AND  SOLVER 

STUDENT  MODEL: 

STUDENT  MODEL 

QUIZZING 
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Decides  how  to  present 
information  to  the  student 
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student  based  on 
instructions  from  the 
Metatutor 


Figure  4.2  Description  of  SATS 


Lesson-KB,  and  the  Question  Generator  and  Solver-KB.  The 
student  model  component  consists  of  the  Student  Model-KB  and 
the  Quizzing-KB.  The  tutoring  strategies  component  contains 
the  D iagnost ics-KB,  the  Metatutor-KB,  and  the  Tutor-KB. 

Control .  When  a  student  uses  SATS,  these  knowledge 
bases  interact  with  one  another  as  shown  in  Figure  4.3.  A 
series  of  control  rules  guides  the  tutoring  session  and 
governs  knowledge  base  interactions.  The  current  goal  of 
SATS  is  teaching  the  student  about  radars.  Initially,  the 
Quizzing-KB  questions  the  student  about  his  background;  this 
information  forms  the  initial  Student  Model-KB.  After 
ensuring  the  prerequisites  are  met,  the  appropriate  lesson 
is  selected  from  the  Lesson-KB.  Using  this  material,  the 
Presentat ion-KB  leads  the  student  through  the  lesson.  After 
the  Presentat ion-KB  instructs  the  student  on  a  particular 
concept,  the  Question  Generator  and  Solver-KB  makes  up 
appropriate  questions.  For  each  question  generated,  this 
knowledge  base  finds  the  correct  answer  as  well  as  several 
reasonable  incorrect  answers  to  serve  as  distractors.  These 
questions  allow  the  student  to  apply  what  he  has  learned  and 
gives  SATS  feedback  on  how  well  the  student  is  learning  the 
information.  If  the  student  answers  correctly,  the 
Presentat i on-KB  presents  the  next  concept.  If,  on  the  other 
hand,  the  student  admits  that  he  does  not  know  the  answer  or 
if  he  answers  incorrectly,  the  Diagnost ics-KB  determines  the 
cause  of  the  student's  problem  from  information  in  the 
Student  Model-KB;  if  more  information  is  needed,  the 
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Figure  4.3  Interaction  among  Knowledge  Bases 
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Quizzlng-KB  asks  additional  questions. 


Once  the 


Dlagnost ics-KB  determines  the  cause,  the  Qulzzing-KB  asks 
more  questions  to  confirm  it.  The  Metatutor-KB  then  decides 
the  appropriate  tutoring  approach  and  directs  the  Tutor-KB 
to  present  the  material.  While  the  Tutor-KB  is  presenting 
the  material,  the  Quizzing-KB  asks  the  student  questions; 
the  Student  Model-KB  is  updated  based  on  the  student's 
answers.  After  the  remedial  tutoring  is  finished,  the 
Question  Generator  and  Solver-KB  confirms  that  the  student's 
problem  is  corrected.  SATS  then  proceeds  with  the  lesson. 

Knowledge  Bases.  Having  considered  the  interaction  of 
the  knowledge  bases  from  the  viewpoint  of  the  control 
structure,  this  same  interaction  is  now  examined  from  the 
viewpoint  of  the  individual  knowledge  bases  by  explaining 
the  function  of  the  knowledge  base  and  then  showing  how  it 
interacts  with  the  other  knowledge  bases. 

Lesson  Knowledge  Base.  The  Lesson-KB  contains  a 
number  of  lessons.  The  student  reads  the  assigned  material 
before  covering  a  lesson  with  SATS.  Each  lesson  in  SATS 
then  emphasizes  some  of  the  more  important  concepts.  Once 
the  concept  is  mastered,  the  next  concept  is  tutored. 

Presentation  Knowledge  Base.  The  Presentat ion-KB 


ih 


leads  the  student  through  a  particular  lesson 


After  a 


concept  has  been  explained,  the  student  is  asked  a  series  of 
questions.  Depending  on  how  he  answer^  the  questions,  the 
Presentat lon-KB  either  continues  leading  the  student  through 
the  presentation  or  the  D lagnost ics-KB  determines  why  the 
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student  made  an  incorrect  response  before  the  lesson  is 
continued. 

Question  Generator  and  Solver  Knowledge  Base.  The 
Question  Generator  and  Solver-KB  develops  questions  based  on 
the  type  of  material  covered  and  on  the  student's  experience 
level.  As  the  student  answers  these  questions,  both  he  and 
SATS  learn  how  well  he  understands  the  material.  From  the 
results  of  these  answers,  SATS  orients  the  session  to  meet 
the  student's  neads. 

Student  Model  Knowledge  Base.  To  tailor  the 
teaching  process  to  the  student,  SATS  must  know  the 
student's  level  of  knowledge  and  experience.  The  Quizzing- 
KB  initially  asks  the  student  a  series  of  questions  from 
which  the  initial  Student  Model-KB  is  created.  Throughout 
the  session,  the  Student  Model-KB  is  updated  from  the 
student's  responses  to  questions  developed  by  the  Question 
Generator  and  Solver-KB  and  from  questions  asked  by  the 
Quizzing-KB.  Other  knowledge  bases  use  the  Student  Model-KB 
to  select  the  appropriate  lesson  to  present  to  the  student, 
to  develop  questions  with  the  proper  degree  of  difficulty, 
to  diagnose  the  student's  error,  and  to  determine  the 
correct  type  of  tutoring  presentation.  At  the  end  of  a 
consultation,  the  Student  Model-KB  is  retained. 

Quizzing  Knowledge  Base.  The  Quizzing-KB  is  first 
used  to  build  the  initial  Student  Model-KB.  It  is  also  used 
to  update  the  Student  Model-KB  if  the  Diagnost lcs-KB  needs 
additional  Information  before  determining  the  student's 
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problem.  Finally,  SATS  asks  questions  during  the  remedial 
tutoring  process  to  update  the  Student  Model-KB  and  allow 
the  Tutor-KB  to  tailor  its  instruction  to  the  student. 

Diagnostics  Knowledge  Base.  If,  during  a  lesson, 
a  student  does  not  answer  a  question  correctly,  the 
Diagnost ics-KB  discovers  the  cause  based  on  the  student's 
error  and  the  Student  Model-KB.  If  the  information  in  the 
Student  Model-KB  is  insufficient  for  the  Diagnost ics-KB  to 
determine  the  cause,  the  Quizzing-KB  asks  the  student  the 
appropriate  questions.  After  this  information  becomes 
available,  the  Diagnost ics-KB  determines  the  cause  and  the 
Quizzing-KB  confirms  it. 

Metatutor  Knowledge  Base.  Once  the  Diagnost ics-KB 
determines  the  cause,  the  Metatutor-KB  decides  how  to 
present  the  remedial  tutoring  based  on  the  Student  Model-KB 
as  well  as  on  the  particular  problem.  The  Metatutor-KB 
operates  through  a  series  of  metarules  (that  is,  rules  about 
rules)  consisting  of  a  premise  that  identifies  when  to  apply 
the  metarule  and  a  series  of  steps  to  be  accomplished  if  the 
premise  is  satisfied.  For  example,  the  premise  may  state 
that  for  a  certain  type  of  problem  and  for  a  student  with  a 
given  experience  level,  the  problem  should  be  introduced, 
the  concept  defined,  and  then  an  example  given.  It  then 
directs  the  Tutor-KB  to  follow  these  steps.  However,  in 
giving  the  example,  a  more  basic  concept  may  need  to  be 
explained;  the  Metatutor-KB  then  decides  how  to  present  this 
more  basic  concept  before  the  original  problem  is  corrected. 
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Tutor  Knowledge  Base, 
forms  of  explanation  (for  example,  definition,  analogy, 
etc.)  for  presenting  the  different  concepts.  It  also  has 
several  levels  for  each  of  these  forms  of  explanation.  For 
example,  the  Tutor-KB  has  several  explanations  describing 
when  to  apply  a  certain  principle,  several  definitions  for  a 
particular  term,  etc.  Providing  several  choices  for  each  of 
these  forms  of  explanation  gives  SATS  the  flexibility  to 
tailor  the  total  presentation  to  the  student's  level  of 
knowledge . 

Task-Oriented  Instruction 

The  goal  of  SATS  may  be  changed  from  communicating 
general  knowledge  about  a  subject  domain  (generative  CAI)  to 
teaching  a  student  how  to  perform  a  task  (task-oriented 
CAI).  This  requires  extensive  changes  to  the  problem¬ 
solving  expertise  component  of  the  tutoring  system.  The 
Lesson-KB,  Presentat ion-KB,  and  Question  Generator  and 
Solver-KB,  which  are  Included  in  this  component  of  the 
current  SATS,  are  replaced  by  a  Task-KB  and  a  Guidlng-KB. 
These  are  described  below.  For  this  new  system,  the  control 
rules  remain  the  same,  and  the  knowledge  bases  for  the  other 
components  require  only  moderate  changes. 

Task  Knowledge  Base.  Before  a  tutoring  system  can 
teach  a  student  how  to  perform  a  task,  it  must  be  able  to 
perform  the  task  itself.  This  knowledge  base  is  often  an 
expert  system. 
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Guiding  Knowledge  Base.  Using  the  Task-KB  as  the 
source  of  expertise,  the  Guldlng-KB  leads  the  student 
through  the  problem-solving  process.  The  goal  of  the  system 
may  be  for  the  student  to  arrive  at  the  same  final  answer  as 
the  Task-KB.  In  this  case,  the  Task-KB  solves  the  case 
completely  before  tutoring  the  student,  the  student  acts  as 
a  consultant,  and  his  final  answer  is  compared  with  that  of 
the  Task-KB.  However,  to  give  the  student  more  freedom,  the 
Guiding-KB  may  direct  the  Task-KB  to  find  intermediate 
solutions  based  on  the  information  available  to  the  student 
and  then  compares  these  answers  with  the  student's  answers. 

Summary 

SATS  is  designed  to  imitate  the  tutoring  process  used 
by  an  Instructor.  That  is,  when  a  student  makes  an  error, 
SATS  attempts  to  diagnose  the  cause  of  the  error,  decide  how 
to  correct  it,  and  then  correct  it.  Whereas  ICAI  systems 
are  generally  divided  into  the  three  main  components  of 
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Implementation  of  SATS 


SATS'  modular  design,  as  described  in  the  previous 
chapter,  allows  the  individual  knowledge  bases  to  be 
developed  to  different  levels  and  yet  allows  the  Integrated 
system  to  be  tested.  For  this  project,  most  of  the 
developmental  effort  is  directed  towards  the  Question 
Generator  and  Solver-KB.  After  giving  a  brief  overview  of 
the  current  status  of  SATS'  development,  this  chapter 
discusses  how  each  knowledge  base  is  implemented. 


Overview  of  SATS 

Figure  5.1  shows  who  performs  the  various  functions 
required  by  SATS.  It  also  Indicates  the  degree  of 
development  for  each  knowledge  base  and  the  relative  ease  of 
applying  a  particular  knowledge  base  to  another  subject 
domain.  Since  the  inference  engine  and  user  interface  are 
supplied  by  M.l,  most  of  the  effort  can  be  directed  towards 
developing  the  knowledge  bases.  The  degree  of  development 
for  the  control  structure  allows  all  of  the  teaching 
knowledge  bases  to  be  used.  While  the  basic  structures  for 
the  teaching  knowledge  bases  have  been  developed,  they  need 
to  be  maintained  or  extended  by  an  instructor  with  some 
experience  with  M.l.  Since  most  of  the  developmental  effort 
centers  around  the  Question  Generator  and  Solver-KB,  the 


extent  to  which  the  other  knowledge  bases  are  developed 
depends  on  the  requirements  of  the  Question  Generator  and 
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Figure  5.1  Function  Matrix  for  SATS 
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Solver-KB.  Except  for  the  Lesson-KB  and  the  Presentat ion- 
KB,  whose  knowledge  Is  specific  to  a  particular  subject 
domain,  the  knowledge  bases  are  relatively  easy  to  adapt  to 
a  different  subject  domain. 

Problem-Solving  Expertise 

As  discussed  in  Chapter  Two,  the  problem-solving 
expertise  component  of  an  ICAI  contains  the  material  for  the 
student  to  learn.  This  expertise  may  be  general  knowledge 
about  the  subject  domain  (generative  CAI),  or  it  may  teach 
the  student  how  to  perform  a  specific  task  (task-oriented 
CAI).  As  the  purpose  for  SATS  is  to  instruct  general 
knowledge  about  radars,  the  generative  type  of  ICAI  forms 
the  operating  model  of  SATS. 

Lesson  Knowledge  Base.  The  material  used  to  teach  the 
student  is  in  the  Lesson-KB.  The  four  types  of 
instructional  material  are  facts,  concepts,  principles,  and 
procedures  (Wedman  and  Stefanich,  1984:23).  A  fact  is  a 
piece  of  information,  such  as  R  represents  range,  and  has  to 
be  memorized.  A  concept  contains  a  set  of  ideas  or  objects 
which  have  a  common  attribute;  antenna  gain  is  a  concept.  A 
principle  shows  how  concepts  are  related;  an  example  is  the 
relationship  between  the  range  at  which  a  target  can  be 
detected  and  the  antenna  gain  of  the  radar.  A  procedure  is 
a  way  to  accomplish  some  task  (for  example,  tuning  a  signal 
on  an  oscilloscope).  SATS  tutors  and  tests  the  first  three 


types  of  instructional  material. 


These  are  examined  more 


closely  in  a  later  section  on  the  Question  Generator  and 


Solver-KB.  The  fourth  type  of  instructional  material, 
procedures,  was  discussed  in  the  previous  chapter  (see  task- 
oriented  instruction). 

For  this  project,  the  lesson  material  is  based  on  the 
radar  range  equation.  Although  the  radar  range  equation 
exists  in  several  forms,  the  following  equation  is  used  for 
purposes  of  this  discussion. 


R  = 


/  4 


(  1) 


where 

R  is  range 

Pt  is  power  transmitted 
is  antenna  gain 
,\  is  wavelength 
<j  is  radar  cross  section 
Pr  is  power  received 

In  this  form,  the  radar  range  equation  relates  the 
effect  that  different  parameters,  such  as  antenna  gain  or 
the  power  transmitted,  have  on  the  range  at  which  a  target 
can  be  detected.  The  material  in  this  knowledge  base  is 
easily  revised  by  changing  the  text. 

Presentation  Knowledge  Base.  In  SATS,  the  presentation 
of  a  lesson  is  controlled  through  an  ordered  listing  of  the 
concepts  to  be  taught.  Although  this  list  fixes  the  way  a 
lesson  is  developed,  it  can  be  easily  changed  by  adding, 
deleting,  or  reordering  concepts  in  the  list. 
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Figure  5.2  Question  Generator  and  Solver  Knowledge  Base 


Question  Generator  and  Solver  Knowledge  Base.  This  is 
the  most  developed  knowledge  base.  It  tests  the  student  on 
material  represented  by  the  first  three  types  of 
instructional  material  mentioned  in  the  Lesson-KB  section. 
Figure  5.2  shows  the  inputs  and  outputs  for  this  knowledge 
base.  The  knowledge  representation  strategy  for  each  of 
tnese  allows  the  Question  Generator  and  Solver-KB  to  reason 
over  the  knowledge  and  generate  questions,  answers,  and 
distractors.  These  distractors  are  answers  which  are 
incorrect  even  though  they  appear  reasonable.  The 
techniques  used  in  this  knowledge  base  are  described  in  the 
following  subsections. 

Facts .  One  of  the  first  things  a  new  student 
needs  to  learn  is  the  terminology  used  in  the  subject 
domain.  Since  the  lesson  material  developed  for  this 
project  focuses  on  the  radar  range  equation,  the  terms 
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tutored  by  SATS  are  those  used  in  the  equation.  As  with 
most  equations,  the  terms  in  the  radar  range  equation  are 
represented  by  symbols.  After  the  student  is  familiar  with 
the  symbols,  the  Question  Generator  and  Solver-KB  creates  a 
question  by  randomly  selecting  one  of  these  symbols  and  the 
term  it  represents.  It  then  randomly  selects  several  other 
terms  used  in  the  radar  range  equation  as  reasonable 
distractors.  For  a  question  of  this  type,  SATS  might  ask 
the  student  what  the  symbol  a  represents.  In  addition  to 
the  correct  answer,  the  student's  other  choices  could 
include  wavelength,  antenna  gain,  and  power  received. 

Concepts ♦  In  addition  to  associating  a  symbol 
with  the  proper  term,  the  student  needs  to  understand  the 
concept  represented  by  the  term.  This  type  of  material  can 
be  tested  by  having  the  student  define  the  term  (Wedman  and 
Stefanich,  1984:24).  Using  the  same  methods  described  in 
the  preceding  paragraph,  a  term  and  its  appropriate 
definition  is  selected.  Definitions  to  the  other  terms  in 
the  radar  range  equation  are  randomly  selected  as 
distractors . 

Principles ♦  After  becoming  familiar  with  the 
basic  terminology,  the  student  needs  to  know  how  the  terms 
In  the  radar  range  equation  are  related  to  one  another.  He 
needs  to  understand  both  the  qualitative  and  the 
quantitative  relationships.  Qualitative  reasoning  looks  at 
the  gross  features  of  a  problem.  For  example,  if  a  ball  is 
released  on  an  inclined  plane,  qualitative  analysis  predicts 


that  it  will  roll  to  the  bottom  whereas  quantitative 
analysis  determines  the  ball's  velocity  at  the  bottom  of  the 
inclined  plane  (de  Kleer,  1979:14).  Qualitative  reasoning 
not  only  helps  determine  how  to  attack  a  problem  but  also 
provides  a  structure  for  quantitatively  solving  it  (de 
Kleer,  1979:12,14). 

For  SATS  to  generate  questions,  answers,  and 
distractors  for  the  radar  range  equation,  the  equation  needs 
to  be  entered  as  a  binary  list.  Equation  1  appears  below  in 
its  more  general  form 


and  then  in  its  canonical  form. 
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Initially,  the  student  is  concerned  with  only 
qualitative  relationships.  For  instance,  does  increasing 
the  antenna  gain  <G)  increase,  decrease,  or  have  no  effect 
on  the  detection  range  for  a  radar?  To  create  a  question 
and  then  find  its  correct  answer,  the  Question  Generator 
and  Solver-KB  randomly  selects  a  term;  for  this  example, 
assume  antenna  gain  is  selected.  Then,  by  applying  a  series 
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of  rules,  it  determines  if  antenna  gain  is  in  the  equation 
and,  if  it  is,  whether  it  is  in  the  first  part  (numerator) 
or  last  part  (denominator)  of  the  list.  Since  antenna  gain 
is  in  the  numerator,  SATS  knows  that  range  is  directly 
related  to  antenna  gain.  After  SATS  finds  the  answer,  it 
tests  the  student  on  this  relationship.  Regardless  of  the 
qualitative  relationship,  the  choices  available  to  the 
student  are  that  the  relationship  between  terms  is  direct, 
inverse,  or  unrelated. 

In  addition  to  just  knowing  whether  the 
relationship  between  antenna  gain  and  detection  range  is 
direct,  inverse,  or  unrelated,  the  student  should  appreciate 
the  sensitivity  between  the  two  terms.  Again,  for  the 
Question  Generator  and  Solver-KB  to  find  the  answer,  the 
equation  must  be  in  the  canonical  form  shown  earlier.  After 
randomly  selecting  a  term  from  the  equation,  the  Question 
Generator  and  Solver-KB  randomly  selects  an  amount  to  vary 
it.  For  this  example,  assume  that  antenna  gain  (G)  is 
doubled.  To  find  the  correct  answer,  the  Question  Generator 
and  Solver-KB  must  find  the  qualitative  relationship  and  the 
exponential  relationship  between  range  and  antenna  gain. 
Once  it  finds  the  answer,  the  Question  Generator  and  Solver- 
KB  creates  distractors  by  varying  the  true  qualitative  and 
exponential  relationships  between  range  and  antenna  gain.  A 
sample  question  Is  shown  below. 
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How  does  Increasing  G  by  a  factor  of  2.0  affect  R? 


1 .  0.5 

2.  0.707 

3.  1.414 

4.  2.0 


Student  Model 

The  student  model  component  contains  information  on  the 
student's  familiarity  with  the  subject  domain  as  well  as  his 
past  performance  in  answering  questions.  In  SATS,  this 
component  consists  of  the  Student  Model-KB  and  the  Quizzing- 
KB. 

Quizzing  Knowledge  Base.  This  knowledge  base  Initially 
asks  the  student  a  series  of  questions  about  the  subject 
domain;  from  these  questions,  an  initial  student  model  can 
be  formed.  Although  the  system  design  allows  the  Quizzing- 
KB  to  later  modify  the  Student  Model-KB,  the  present  system 
only  uses  the  Quizzlng-KB  to  form  the  initial  Student  Model- 
KB. 

Student  Model  Knowledge  Base.  The  Student  Model-KB 
influences  how  the  tutoring  system  interacts  with  the 
student.  From  the  questions  asked  by  the  Quizzing-KB,  the 
student's  knowledge  about  different  parts  of  the  lesson  is 
classified  as  basic,  average,  or  advanced.  This  allows  the 
tutoring  to  better  focus  on  his  needs.  Although  Figure  5.3 
shows  a  student  with  an  advanced  understanding  of  terms  and 
definitions  and  a  basic  understanding  of  the  qualitative  and 
quantitative  relationships  between  terms,  this  Is  only  one 
of  eighty-one  possible  student  models  in  the  present 


Student 
Exper ience 


Types  of  Lesson  Material 


Termi¬ 

nology 

Defini¬ 

tions 

Qual  i  - 
tat  i  ve 

Quant i - 
tat i ve 

Basic 

X 

X 

Average 

Advanced 

X 

X 

Figure  5.3  Example  Student  Model 


system.  Figure  5.4  shows  that  although  an  initial  student 
model  is  created  based  on  questions  from  the  Quizzing-KB,  it 
is  updated  based  on  the  student's  answers  to  test  questions. 
The  student's  classification  in  a  particular  area  may  remain 
the  same  or  change  to  a  higher  or  lower  classification 
level.  This  classification  level  affects  the  number  of 
questions  he  is  asked  and  the  type  of  remedial  tutoring  he 
receives  after  incorrectly  answering  a  question.  To  update 
the  student  model  after  the  student  has  answered  a  series  of 
questions,  the  following  production  rule  is  used. 

IF  the  number  of  questions  answered  correctly  is  X  and 
the  number  of  questions  asked  is  Y  and 
X/Y  >  .5  and 
X/Y  <  .75 

THEN  the  student's  proficiency  level  is  average. 

Tutoring  Strategies 

The  tutoring  strategies  component  determines  why  the 
student  makes  an  error,  how  to  correct  it,  and  then 
corrects  it.  The  Diagnost Ics-KB,  the  Metatutor-KB,  and  the 


Tutor-KB  perform  these  functions. 


■_VV. 


INPUTS 


OUTPUTS 


Figure  5.4  Student  Model  Knowledge  Base 


Diagnostics  Knowledge  Base.  No  attempt  is  made  to 
include  diagnostic  principles  from  cognitive  psychology  in 
this  system*  that  is.  the  Diagnost ics-KB  only  looks  at  what 
the  student  misses  rather  than  why  he  misses  it.  Since  SATS 
is  restricted  to  asking  questions  with  multiple  choice 
answers,  the  distractors  are  generated  based  on  possible 
errors  the  student  may  commit.  Therefore,  if  the  student 
selects  an  incorrect  answer,  the  Diagnost ics-KB  assumes  that 
the  student  is  using  the  same  incorrect  procedure  employed 
by  the  Question  Generator  and  Solver-KB  to  generate  the 
distractor . 

Metatutor  Knowledge  Base.  This  knowledge  base  uses 
information  from  the  D iagnost ics-KB  to  decide  what  to  tutor, 
utilizes  information  from  the  Student  Model-KB  to  determine 
the  depth  of  tutoring,  and  combines  these  to  decide  how  to 
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correct  the  student's  error.  For  instance  if  a  student 
misses  the  effect  of  doubling  the  antenna  gain  on  the 
detection  range#  he  receives  remedial  tutoring  based  on  his 
experience  level  and  on  the  incorrect  answer  he  selects. 

Tutor  Knowledge  Base.  This  knowledge  base  provides  the 
actual  remedial  tutoring  based  on  information  from  the 
Metatutor-KB.  It  tutors  the  different  types  of  material  for 
students  of  different  proficiency  levels.  An  advanced 
student  is  simply  told  that  the  answer  is  incorrect  and 
given  another  chance,  a  student  of  average  experience  is 
given  some  hints  before  trying  again,  while  the  basic 
student  is  given  a  more  extensive  explanation  before  he 
selects  another  answer. 

Summary 

As  a  tutoring  system  SATS  does  not  exhibit  all  of  the 
behaviors  described  in  Chapter  Four.  However,  all  eight 
knowledge  bases  contained  in  the  system  design  have  been 
exercised  separately  as  well  as  in  the  integrated  system. 
The  Question  Generator  and  Solver-KB,  receiving  the  most 
emphasis,  generates  questions,  answers,  and  distractors  for 
facts,  concepts,  and  principles.  The  following  chapter 
describes  the  contributions  from  this  project,  makes 
recommendations  for  future  research,  and  develops 


concl us  ions . 


VI.  Suwwary  and  Conclusions 


Introduct ion 

This  study  proposes  a  generic  design  for  an  ICAI 
system.  With  primary  emphasis  on  the  Question  Generator  and 
Solver-KB  and  secondary  emphasis  on  the  Student  Model-KB, 
this  design  is  implemented  using  the  M.l  expert  system 
building  tool.  This  chapter  discusses  some  contributions 
from  this  study,  suggests  areas  for  further  research,  and 
offers  some  conclusions. 

Contributions 

System  Design  and  Testing.  A  major  contribution  from 
this  study  is  the  generic  design  of  an  ICAI  system  which 
presents  lesson  material,  tests  the  student,  diagnoses  his 
errors,  determines  how  to  correct  them,  and  then  corrects 
them.  By  partitioning  the  knowledge  needed  by  an  ICAI 
system  into  eight  knowledge  bases,  this  design  allows 
research  to  be  focused  on  specific  knowledge  bases.  Testing 
this  design  with  the  M.l  expert  system  tool  demonstrates  the 
feasibility  of  the  design  as  well  as  the  practicality  of 
using  an  expert  system  building  tool  as  a  basis  for  an  ICAI 
system. 

Knowledge  Representation  Strategies.  The  development 
of  different  knowledge  representation  strategies  allows  SATS 
to  test  the  student  and  then  correct  his  errors.  Since 
these  strategies  are  tied  only  to  the  form  of  the  knowledge 
(for  example,  terms  or  equations),  they  can  be  used  for  any 


subject  domain. 


Instructions  for  adding  new  terms  or 


equations  to  SATS  are  given  in  Appendix  A. 

Question  Generator  and  Solver-KB.  The  Question 
Generator  and  Solver-KB  allows  SATS  to  reason  over  a 
knowledge  representation  strategy  (for  terms  or  equations) 
to  develop  questions,  answers,  and  distractors.  As  long  as 
any  equation  is  entered  into  SATS  in  the  canonical  form,  the 
Question  Generator  and  Solver-KB  can  perform  the  same 
function  as  it  now  does  for  the  radar  range  equation. 

Use  of  M . 1 .  This  is  the  first  AFIT  thesis  to  be  based 
entirely  on  M.l.  During  this  effort,  several  new  techniques 
were  developed  which  may  be  used  for  other  projects.  These 
techniques  are  noted  in  Appendix  A.  Experience  with  M.l 
gained  from  this  project  provides  a  basis  for  evaluating 
M.l.  Some  advantages  and  limitations  of  M.l  are  discussed 
later  in  the  chapter. 

Student  Model -KB.  The  Student  Model-KB  allows  SATS  to 
better  orient  the  tutoring  to  the  student's  needs.  The 
initial  student  model  is  formed  from  questions  asked  of  the 
student  and  then,  based  on  the  student's  performance,  the 
student  model  is  updated  throughout  the  session. 

Areas  for  Future  Research 

SATS  provides  the  framework  for  developing  a  tutoring 
system.  Using  its  current  knowledge  representation 
strategies,  SATS  can  test  and  tutor  a  student  on  terminology 
and  on  the  relationships  between  the  variables  in  a  single 


equat i on . 


Although  SATS  may  be  expanded  using  these  current 


knowledge  representation  strategies,  additional  knowledge 
representation  strategies  are  needed  to  make  SATS  function 
as  a  true  ICAI  system.  Two  additional  areas  for  research  are 
using  external  data  bases  to  store  the  subject  material  and 
converting  SATS  to  a  task-oriented  CAI . 

Knowledge  Representation  Strategies .  The  more 
knowledge  representation  strategies  available  to  SATS,  the 
greater  its  capability.  The  next  level  of  complexity  in 
knowledge  representation  strategies  is  the  semantic  network. 
Using  a  semantic  network  requires  adapting  the  rule-based 
format  of  M.l  to  support  a  semantic  network  or  converting 
SATS  to  an  environment  more  suited  to  using  a  semantic 
network.  An  example  of  a  semantic  network  of  radar 
characteristics  is  shown  in  Figure  6.1.  Suggestions  for 
further  research  based  on  a  semantic  network  are  discussed 
below  in  order  of  increasing  difficulty. 

Identifying  and  Describing  Radar  Characteristics. 
Using  this  network,  SATS  can  collect  the  characteristics  of 
a  particular  radar.  It  can  then  ask  the  student  to 
identify  a  particular  radar  from  a  list  of  characteristics, 
or  SATS  can  give  the  student  a  radar  and  ask  him  to  describe 
its  characteristics.  This  idea  can  be  further  extended  by 
collecting  the  characteristics  of  more  than  one  radar, 
finding  their  common  characteristics,  and  then  asking  the 
student  to  identify  these  common  characteristics. 
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Figure  6.1  Semantic  Network  for  Radars 


Relational  Questions.  The  Question  Generator  and 
Solver-KB  may  use  the  semantic  network  to  select  two  nodes 
in  the  semantic  network.  With  the  three  pieces  of 
information  represented  by  the  two  nodes  and  the 
relationship  between  them,  SATS  may  give  the  student  two  of 
them  and  ask  him  to  Identify  the  third.  Using  Figure  6.1  as 
an  example,  SATS  may  select  the  two  nodes  as  target 
acquisition  radar  and  narrow  azimuth  beamshape  and  ask  the 
student  to  identify  the  type  of  beamshape  for  a  target 
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acquisition  radar.  The  student  is  expected  to  either 
mentally  trace  the  path  between  the  nodes  or  be  able  to 
establish  a  direct  link  between  the  target  acquisition  radar 
and  its  beamshape.  The  Question  Generator  and  Solver-KB  may 
find  distractors  by  finding  the  types  of  beamshapes  for 
other  radars. 

Tutoring .  After  the  student  misses  a  question, 
the  trace  function  of  the  inference  process  can  lead  the 
student  from  the  question  to  the  answer.  Each  time  the 
student  misses  the  question,  the  system  shows  him  an 
intermediate  node  between  the  question  and  the  answer.  The 
first  time  the  student  misses  the  question,  he  is  given 
information  about  the  node  next  to  the  question;  as  he 
continues  to  miss  the  question,  he  is  given  information  from 
nodes  which  are  progressively  closer  to  the  answer  until 
finally,  if  the  student  does  not  choose  the  correct  answer 
before  the  tutor  reaches  the  answer  node,  the  system  gives 
him  the  correct  answer. 

Extending  the  Current  System.  Although  further 
development  of  most  of  the  knowledge  bases  requires  a  new 
knowledge  representation  strategy  such  as  described  above, 
the  equation  handler  may  be  extended  as  described  below. 

Converting  Equations  to  Canonical  Form.  The 
current  system  requires  equations  to  be  entered  into  SATS  in 
a  canonical  form  before  they  can  be  used  to  develop 
questions.  The  system  should  allow  equations  to  be  entered 


VI  -  5 


in  another  more  general  form  and  then  have  the  system 
convert  them  to  the  required  canonical  format. 

Sensitivity  Analysis.  The  present  equation 
handler  performs  sensitivity  analysis  between  the  dependent 
variable  and  a  single  independent  variable.  It  could 
conduct  sensitivity  analysis  on  more  than  one  independent 
variable  by  changing  each  independent  variable,  in  turn,  to 
see  the  effect  on  the  dependent  variable  and  then  combining 
these  effects  into  an  overall  effect. 

Converting  SATS  to  Task-Oriented  Instruction.  SATS  now 
presents  the  student  with  information  about  radars.  By 
changing  the  expertise  component  to  accomodate  an  expert 
system,  SATS  can  be  converted  to  lead  a  student  through  the 
process  of  performing  a  task. 

External  Data  Base.  SATS,  in  its  present  form, 
contains  the  control  function,  the  teaching  modules,  and  the 
information  specific  to  the  subject  area  in  a  single 
computer  file.  As  the  lesson  material  grows,  it  needs  to  be 
separated  from  the  control  and  teaching  functions  of  SATS. 
Although  M.l  permits  external  files  to  be  used,  the 
necessary  interfaces  need  to  be  developed. 

Concl us i ons 

Background  Required  to  Use  M.l .  A  person  need  not  have 
an  extensive  computer  background  to  use  M.l,  but  he  should 
have  a  basic  understanding  of  artificial  intelligence 
techniques.  Although  the  documentation  for  M.l  is  fairly 


extensive,  the  one-week  course  on  M.l  offered  by  the 
Artificial  Intelligence  Laboratory  is  invaluable. 

Limitations  of  M.l.  Although  M.l  offers  a  powerful 
developmental  environment  for  SATS,  its  use  in  an  actual 
training  environment  is  doubtful.  It  is  primarily  limited 
by  the  size  of  its  rule-base  (no  more  than  1000  rules)  and 
its  speed.  The  computer  code  was  changed  in  an  effort  to 
reduce  the  time  required  to  generate  questions,  answers,  and 
distractors  for  terms.  This  shortened  the  time  by 
approximately  one-half,  but  the  time  required  was  still 
approximately  35  seconds.  Few  students  are  willing  to  wait 
that  long. 

Continued  Development  of  SATS.  Training  new  personnel 


in  an  organization  requires  significant  time  and  effort  by 
the  organization's  experts.  Intelligent  Computer  Aided 
Instruction  systems  provide  a  cost-effective  alternative  for 
training  new  personnel.  Although  the  system  design  proposed 


in  this  thesis  appears  sound,  the  full  development  of  SATS 
may  take  considerable  effort  by  experienced  knowledge 
engineers  using  large,  hybrid  system  building  tools. 


Appendix  A 

Instructor's  Guide  for  SATS 

Introduct ion 

This1  appendix  explains  the  organization  of  SATS' 
computer  code  (listed  in  Appendix  B),  the  procedures  to 
modify  what  SATS  tutors,  and  some  of  the  useful  programming 
techniques  used. 


Organization  of  SATS 

Although  all  of  the  rules  for  SATS  are  in  a  single 
file,  a  particular  rule  may  be  found  in  its  appropriate 


knowledge  base. 


The  knowledge  bases  are  listed 


alphabetically  according  to  the  name  of  the  knowledge  base, 
and  each  rule  within  a  particular  knowledge  base  is  listed 
according  to  the  function  it  performs.  To  help  the 
instructor  locate  a  particular  rule,  a  listing  of  the 
knowledge  bases  and  the  rules  within  each  knowledge  base  is 
at  the  end  of  the  computer  code  in  Appendix  B.  Following  is 
a  brief  description  of  each  knowledge  base. 

The  Control  Rules  Knowledge  Base  forms  a  step  by  step 


process  for  conducting  the  overall  session. 


It  is 


responsible  for  such  things  as  establishing  the  initial 
student  model  and  selecting  the  appropriate  lesson. 

The  Diagnostics  Knowledge  Base  determines  the  reason  a 
student  selects  an  incorrect  answer. 


The  Lesson  Knowledge  Base  contains  the  instructional 


text  for  the  lesson. 


The  Metatutor  Knowledge  Base  decides  how  to  present  the 
remedial  tutoring  according  to  the  student's  proficiency  and 
the  type  of  question  he  misses. 

The  Presentation  Knowledge  Base  leads  the  student 
through  a  particular  lesson.  A  lesson  is  divided  into 
sections,  and  sections  are  further  divided  into  slides. 
This  knowledge  base  contains  a  list  of  the  sections  in  a 
particular  lesson  and  a  list  of  the  slides  for  each 
sect  ion. 

The  Question  Generator  and  Solver  Knowledge  Base 
contains  the  terms  and  equations  from  which  questions  are 
developed.  It  also  includes  the  procedures  for  developing 
the  questions,  answers,  and  distractors. 

The  Quizzing  Knowledge  Base  is  a  series  of  questions 
asked  of  the  student  to  obtain  information  to  create  the 
initial  student  model. 

The  Student  Model  Knowledge  Base  is  a  series  of  topics 
necessary  to  form  the  student  model.  Since  the  actual 
student  model  keeps  changing,  it  is  retained  in  working 
memory . 

The  Tutor  Knowledge  Base  tutors  the  student  depending 
on  his  proficiency  level,  the  question  he  missed,  and  the 
reason  he  missed  the  question.  It  also  governs  the  number 
of  chances  the  student  is  given  before  he  is  told  the 
correct  answer. 

The  Miscellaneous  Functions  Knowledge  Base  contains 
rules  which  do  not  fit  in  any  other  knowledge  base.  These 
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include  rules  for  finding  the  length  of  a  list,  removing 
items  from  a  list,  etc. 

Changing  the  Information  in  SATS 

Changing  the  Material  Presented.  As  discussed  above, 
the  Presentat ion-KB  operates  through  ordered  lists. 
Modifying  the  sections  within  a  lesson  or  the  slides  within 
a  section  merely  requires  changing  the  appropriate  list. 

Changing  Terms.  This  Information,  which  generates 
questions  and  answers,  is  in  the  Question  Generator  and 
Solver-KB.  To  change  the  terms  on  which  the  student  is 
tested  requires  changing  the  list  of  terms  in  the 
'symbols_for-section<terms) '  rule.  Additional  changes  must 
be  made  to  the  ' term_f or_answer *  ,  'answer_for_def init ion' , 
and  the  'answer_f or_ter* *  rules. 

Changing  Equations.  This  requires  changes  to  two  rules 
in  the  Question  Generator  and  Solver-KB.  The  ’ symbols_f or- 
sect i on(equat ions ) '  rule  is  changed  to  reflect  the  terms 
used  in  the  equation.  The  equation  is  also  entered  in  its 
canonical  form  into  the  'def ine_equat ion'  rule. 

Programming  Techniques 

Speed  Versus  Flexibility.  Speed  and  flexibility  are 
two  goals  for  SATS.  For  SATS  to  have  flexibility  requires 
using  lists  and  recursive  functions.  However,  both  of  these 
slow  SATS  speed.  Therefore,  the  code  for  SATS  balances 
these  two  goals.  One  technique  uses  both  facts  and 
recursive  rules  for  some  functions.  An  example  is  shown  in 
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the  'length'  rule  in  the  Miscellaneous  Functions  Knowledge 
Base.  When  a  list  is  no  longer  than  four  elements,  its 
length  is  determined  by  one  of  the  'length'  facts.  However, 
when  the  length  exceeds  four  elements,  a  'length'  rule 
counts  the  number  of  elements  in  the  list  by  groups  of  four 
until  there  are  less  than  four  remaining  elements.  These 
remaining  elements  are  then  counted  by  a  'length'  fact.  An 
instance  where  some  flexibility  is  lost  by  not  using 
recursion  is  in  the  ' make_quest ion'  rule  located  in  the 
Question  Generator  and  Solver-KB.  Not  using  recursion 
results  in  limiting  the  maximimum  number  of  questions  which 
SATS  can  generate  at  any  one  time  to  three  and  in  requiring 
three  rules  -  rules  to  create  one,  two,  or  three  questions  - 
rather  than  a  single  recursive  rule. 

Message  Function.  Another  programming  technique  is 
using  a  single  'message'  rule  for  templates  as  well  as  for 
much  of  the  text.  Since  different  templates  require  passing 
different  numbers  of  variables  and  text  requires  none,  the 
first  argument  to  the  'message'  function  is  the  type  of 
message  and  the  second  argument  is  a  list  of  the  variables 
used . 
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Appendix  B 

Computer  Code  for  SATS 

/*  RULES  FOR  SATS  */ 

initialdata  =  C lesson_complete  ]  . 

/*  CONFIGURATION  META-FACTS  */ 

conf igurat ion(startup)  =  go. 


conf igurat ion(banner)  =  C 

'Welcome  to  the  Signal  Analyst  Tutoring  System.  I  will  instruct 
you  in  some  radar  principles  and  then  ask  you  a  few  questions 
about  these  principles.  If  you  miss  a  question,  I  will  try  to',nl 
'tell  you  why  you  are  wrong  and  then  let  you  try  again.  To  answer 
a  question,  type  in  the  number  preceding  the  answer.  For  example, 
if  the  answer  is  ',nl,  nl, 

'  ''2.  range'',  you  would  type  in  ''2''  '  ,nl,nl, 

'If  you  want  to  quit  before  the  end  of  the  lesson,  type 
<CTRL-BREAK> .  That  will  return  you  to  the  M.l  level.  If  you 
type  <CTRL-BREAK>  again.  It  will  return  you  to  the  DOS  level.', 

'  If  you  have  any  questions,  you  may  need  to  see  your  instructor 


/* 

/*  ======== 

/*  ======== 


CONTROL  RULES  KNOWLEDGE  BASE 


/*  LESSON 

automat ic me nu< lesson) . 
enumeratedanswers ( lesson) . 

quest ionC lesson)  = 

ini,  'Which  lesson  shall  we  cover?’]. 

legal vals( lesson)  =  [ radar_range_equat i on, 

f undamental_re lat ionships, 
decibels] . 


LESSON_COMPLETE 


i  f  seed  =  NUMBER  and 

initial_student_model  is  sought  and 
lesson  =  LESSON  and 

sect  ions (LESSON)  =  LIST J3F.SECTIONS  and 

each-sect i on_type-of-LIST_OF_SECTIONS-of-LESSON  is  complete 
and 

f in ished_with_ lesson 
then  lesson_complete . 


v  *u»yT’j  rj  »  »j  ■  ■  ■ 
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/*  DIAGNOSIS  KNOWLEDGE  BASE  */ 


/*  DIAGNOSIS  */ 

nocache (di agnos is<V,W,X, Y,Z) ) . 

/*  DEFINITIONS  */ 

d i agnos i s  <  TERM , CORRECT_ ANSWER , STUDENT_ANSWER , de  f i n i t i ons , N )  = 
not_know,term . 

/*  QUALITATIVE  RELATIONSHIPS  */ 


d iagnos i s  C  TERM , CORRECT_ANSWER , STUDENT, ANSWER, 
qual i tative, relationships, N)  = 
not_understand_qual i tat i ve_re lat ionsh ip . 


/*  QUANTITATIVE  RELATIONSHIPS  */ 


I 

"w 

% 

i 

I 


r 

r 
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if  CORRECT  ANSWER  ==  IC  ANSWER , C_RELATED , C, EXPONENT J  and 
STUDENT_ANSWER  ==  IS  ANSWER, S  RELATED, S_EXPONENT ]  and 
C  EXPONENT  ==  S_EXPONENT  and 
not  <  C  RELATED  ==  S  RELATED) 
then  d i agnos i s  C TERM , CORRECT, ANSWER , STUDENT, ANSWER , 

quantitative_relationships,N>  =  relationship. 

if  CORRECT  ANSWER  ==  C  C, ANSWER , C.RELATED , C.EXPONENT 1  and 
STUDENT  ANSWER  ==  IS  ANSWER, S_RELA TED, S,EXPONENTJ  and 
C  RELATED  ==  S.RELATED  and 
not C C  EXPONENT  ==  S  EXPONENT) 
then  d i agnos i s < TERM , CORRECTJWSWER , STUDENT, ANSWER , 
quant i tat i ve_relat i onsh ips ,N)  =  factor. 

if  CORRECT, ANSWER  ==  t  C_ANSWER , C.RELATED , C, EXPONENT  1  and 

STUDENTlANSWER  ==  I S~ANSWER , S_RELATED, S_EXPONENT 1  and 
not <C  ANSWER  ==  S  ANSWER)  and 
not C C  EXPONENT  ==  S.EXPONENT) 
then  d iagnos i s( TERM, CORRECT, ANSWER, STUDENT_ANSWER, 

quant i tat i ve_re lat i onsh ips , N)  =  both_wrong. 


/*  TERMS  */ 

d i agnos i s  <  TERM , CORRECT_ANSWER , STUDENT, ANSWER , ter ms , N )  = 
notknow  term . 
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/*  ======== 

/*  =  =  =  =  =  =  =  =  = 
/* 

/*  ========= 

/*  ========= 


LESSON  KNOWLEDGE  BASE 


==========  */ 

==========  */ 

*  / 

==========  */ 

==========  */ 


/*  PRESENTATION  */ 

nocache (presentat ion(X, Y) ) . 

presentat ion< introduce_radar_range_equat ion, why_ i mportant )  =  [ nl , 
'We  will  be  looking  at  the  radar  range  equation  which  relates 
characteristics  of  transmitter,  receiver,  antenna,  target,  and 
environment.',’  I  will  tell  you  why  it  is  important,  explain 
what  the  symbols  mean,  and  how  the  terms  are  related.  We  will 
do  this  for  several  forms  of  the  radar  range  equat ion . ' , nl ] . 

presentat ionCequat ion_l , mot ivat ion)  =  tnl, 

'The  first  radar  equation  is'  ,nl. 


P(r )  = 


<<P(t))  *  <G**2)  *  (lambda**2)  *  sigma) 
<<(4*pi>**3>  *  C R**4 ) ) ' 


»nl , 


'This  equation  is  important  because  it  shows  how  the  power 
received  by  the  radar  is  affected  by  several  factors.','  In  the 
above  equation,  a  single  asterisk  means  to  multiply  the  terms 
while  a  double  asterisk  means  to  raise  the  term  to  a  power.  The 
next  slide  will  define  the  factors  in  the  equat i on .', nl 1 . 

presentat ion(equat ion^l , terms)  =  [nl, 

'The  following  terms  make  up  the  basic  radar  range  equation.', 
nl , nl , 

'  P(r)  is  the  power  received  by  the  radar.'  ,nl, 

'  P(t)  is  the  power  transmitted  by  the  radar.'  ,nl, 

'  G  is  the  gain  of  the  antenna.'  ,nl, 

'  Lambda  is  the  wavelength.'  ,nl, 

'  Sigma  is  the  cross  sectional  area  of  the  target.'  ,nl, 

'  R  is  the  range  of  the  target  from  the  radar.'  ,nll. 

presentat ion(equat i on_l , de f in  1 1 ions >  =  Cnl , 'Equat ion  1 
de  f in i t i ons . ' ,nl 1 . 


4 

I«1 


3! 


presentat i on<equat i on_ 1 ,qual i tat i ve_re lat ionsh ips)  =  tnl, 

'You  will  note  that  the  power  received  by  the  radar  increases 
when  a  term  in  the  numerator  increases  and  it  decreases  as  a 
term  in  the  denominator  Increases  .', nl  ]  . 


k 
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presentat 1 on(equat i on_ 1 , quant  1  tat i ve_re lat i oash i ps )  =  Cnl, 

'The  power  received  at  the  radar  varies  as  the  parameters  on 
the  right  hand  side  of  the  equation  change.  The  effect  of  a 
parameter  on  the  power  received  depends  on  the  amount  the  term 
is  changed  and  the  exponential  factor  of  the  term.',’  For 
instance,  if  the  gain  is  doubled,  the  power  received  is 
quadrupled . ' , nl 1 . 

presentat ion(equat ion_2, mot i vat  ion)  =  tnl, 

'The  next  form  of  the  radar  range  equation  is',nl. 


R  = 


<P<t)  *  (G**2)  *  (lambda**2)  *  sigma) 


( ( (  4*pi )**3)  *  P< r ) > 


(1/4) 


_ ! '  , nl , 


'This  equation  shows  how  the  detection  range  is  affected  by 
several  different  parameters.  Note  that  range  is  related  to 
these  terms  by  the  fourth  root.  There  are  no  new  terms  for 
this  equat i on . ' , nl  1  . 

presentat ionCequat ion_2,qual i tat i ve_re lat i onsh ips )  =  tnl, 
'Again,  note  that  the  range  increases  when  a  paramter  in  the 
numerator  increases  and  decreases  when  a  parameter  in  the 
denominator  increases nl 1 . 

presentation(equation_2,quantitative_relationships>  =  tnl, 
'Remember  that  range  is  affected  by  the  fourth  root  of  the 
other  parameters .' ,nl ] . 


presentat ionCequat ion_3, motivation)  =  tnl, 

'The  last  form  of  the  radar  range  equation  which 
examine  ls',nl. 


we  will 


5  <P(t)  *  (A(e )**2) 

*  sigma)  *  (t(ot)) 

!  (1/4) 

!  _  ( ( 4*p i )  *  S 

*  (lambda**2)) 

, nl , 

'This  form  of  the  equation  considers  the  number  of  radar  pulses 
striking  the  target.  As  the  number  of  pulses  received  from  the 
target  increases,  the  greater  the  detection  range.’, nil. 

presentat lon(equat ion_3, terms)  =  Cnl, 

'Two  new  terms  are  in  this  equat i on .', nl , nl , 

'  A(e)  is  the  effective  antenna  area.',nl, 

'  t(ot)  is  the  length  of  time  the  radar  beam  is  on  the  target, 
nl  1 . 

presentat i on(equat i on_3, de f in i t i ons )  =  tnl,  'Equation  3 
de  f in i t ions . ' , nl 1 . 

presentat ion(equat ion_3,qual I  tat i ve_re lat i onsh ips >  =  tnl, 
'Again,  terms  in  the  numerator  cause  range  to  increase  while 
terms  in  the  denominator  cause  it  to  decrease .', nl 1 . 


presentat i on<equat ion_3, quant i tat i ve_re lat i onsh ips >  =  tnl, 

’The  quantitative  relationships  in  this  equation  are  similar  to 
those  in  the  previous  equat i on . ’ , nl 1 . 

presentat ion< ANY_SECTION,dummy_sl ides)  =  tnl, 

'This  lesson  is  not  installed.  Please  type  ’’abort, 
to  M.l  and  then  type  in  ’’go.’’  to  start  again.’]. 


f  9 


to  return 


ft 


METATUTOR  KNOWLEDGE  BASE 


METATUTOR 


nocache (me  tat utor(X, Y,Z) ) . 
nocache ( metatutor( W,X, Y,Z) ) . 
nocache (metatutor(V,W,X,Y,Z)) . 


/*  QUALITATIVE  RELATIONSHIPS  */ 


me  tatutor ( TERM, not_understand_qual i tat i ve_re lat ionship,direct,N)  = 
TERM- in_numerator-f or_qual i tat ive_re lat ionship. 

me  tat u tor (TERM, not_understand_qual i tat i ve_re lat i onsh ip, inverse , N)  = 
TERM- i n_denomina tor- f or_qual i tat i ve_re lat ionship. 

me  tatutor (TERM, not_understand_qual i tat i ve_re lat i onsh ip, unre lated, N)  = 
TERM-unre lated-f or_qual itat ive_relat ionship. 

/*  QUANTITATIVE  RELATIONSHIPS  */ 

me tatutor (TERM, both  wrong, LEFT-HAND  SIDE, [ANSWER, RELATED, FACTOR] ,N)  = 
TERM- i s-RELATED-to-LEFT_HAND_SIDE-by-FACTOR- 
for_quant itat 1 ve_re lat ionship. 

me tatutor(TERM, factor, LEFT_HAND_SIDE, [ANSWER, RELATED, FACTOR] ,N)  = 
FACTOR-f or-TERM-f or_quant itat ive  relationship  with- 
LEFT_HAND_SIDE . 

me  tat u  tor ( TERM .relationship, LEFT_HAND_S I DE , [ ANSWER .direct, FACTOR ] , N ) 
TERM-in  numerator-f or  quantitative  relationship  with- 
LEFT_HAND_SI DE . 

me tatutor (TERM, re lat i onsh ip,LEFT_HAND_S IDE, [ANSWER, inverse .FACTOR] ,N) 
TERM- in_denom inator- f or_quant i tat i ve_re lat i onsh ip  w i th- 
LEFT_HAND_SI DE . 

me tatutor (TERM, re lat i onsh ip,LEFT_HAND_S IDE, [ ANSWER , unre lated, FACTOR ] , 
N)  =  TERM-unre 1 ated- for_quant i tat i ve_re lat i onsh i p  with- 
LEFT  HAND  SIDE. 


/*  TERMS  */ 

metatutor( no t_know_term , STUDENT_ANSWER , N )  =  define -STUDENT_ANSWER . 
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PRESENTATION  KNOWLEDGE  BASE 


SECTIONS 


nocache (sections(X)). 


sect i ons ( radar_range_equat i on )  =  [ introduce_radar_range_equat i on 

equat i on_ 1 , 
equat ion_2, 
equat i on_3 1 . 

sections<  f  undame ntal _re lationships)  = 

[ introduce_f unda mental _re 1  at i onsh ips , 
wave  length^ frequency » 
pr f _pr i 1 . 

sect i ons (dec i be  1 s )  =  [ i ntroduce_dec ibe 1 s , 

decibels„power, 
dec Ibe 1 s_ vo I tage 1 . 

/*  SLIDES  */ 

nocache(sl ides(LESSON, SECTION) ) . 

si ides(radar_range_equat ion, i ntroduce_radar_range_equat ion)  = 

[ why_important ] . 

si ides(radar_range_equat Ion, equat ion_l )  = 

[motivation, terms, qual itati ve_re lationships, 
quant itati ve_re lat 1 onsh ips  J  . 

si  ides(radar_range_equat ion, equat ion_2)  = 

[ mot i vat i on, qua 1 itati ve_re lat l onsh ips , 
quant itati ve_re lat ionsh i ps 1 . 

si ides(radar_range_equat ion,equation_3)  = 

[motivation, terms, qualitative_relationships, 
quant i tat i ve_re lat ionsh i ps ] . 

slides(X,Y)  =  [dummy_sl ides ] . 


/*  QUESTION  GENERATOR  AND  SOLVER  KNOWLEDGE  BASE  5 

/*  ANSWER  FOR  DEFINITION  */ 


nocache (answer_f or_de  finition(X)). 

answer_for_def init ion< 'R' >  =  tnl, 

'The  radial  distance  from  a  radar  to  a  target  or  other 
object . ' ] . 

answer_f or_de f i n i t i on ( ' P( t ) ’ )  =  ini, 

'The  power  transmitted  by  the  radar.']. 
answer_f or_de f i n i t i on< ' P( r ) ’ )  =  tnl, 

'The  power  received  by  the  radar.’]. 
answer_for_def init ion< 'G' )  =  Ini, 

'The  ratio  of  the  power  of  the  radiation  in  a  given 
direction  to  the  power  of  the  radiation  that  would 
be  produced  in  that  direction  if  the  same  input  power 
were  applied  to  a  hypothetical  isotropic  antenna.']. 
answer_for_def init ion< 'A<e > ’ >  =  tnl, 

'The  physical  area  times  aperture  efficiency.']. 
answer_f or_def ini t ion< ' t <ot ) ' >  =  Ini, 

'The  time  during  which  a  target  is  continuouly  in  the 
mainlobe  of  a  searching  radar' 's  antenna  on  any  one 
scan  of  the  antenna.']. 
answer_for_def init ion(sigma)  =  tnl, 

'A  factor  relating  the  power  of  the  radio  waves  that 
a  radar  target  scatters  back  in  the  direction  of  the 
radar  to  the  power  density  of  the  radar' 's  transmitted 
waves  at  the  target' 's  range.']. 
answer_for_de f in i t ion< lambda)  =  tnl, 

'The  distance  between  successive  ''crests''  or  between 
points  at  which  the  intensity  of  the  field  goes  through 


zero  in  the  same  direction.’]. 


/*  ANSWER.FQR.QUALI TATI VE.RELATI ONSHI PS  */ 

nocache (answer.for.qual itative_relationships(SECTION,TERM)) . 

if  define  equat ion(SECTION)  =  CANONI CAL.EQUATION  and 
re  1  a  ted  (  CANONI CAL.EQUATION,  TERM )  =  RELATIONSHIP 
then  answer  for  qualitative  re lat ionshipsCSECTION, TERM)  = 
RELATIONSHIP. . 


/*  ANSWER.FOR.QUANTI TATI VE.RELATIQNSHIPS  */ 

/*  Restrictions:  Amount  a  parameter  is  changed  >=  1. 

:  A  power  must  be  an  integer. 

:  A  root  multiplied  by  2  must  eventually  =  1. 

:  Quotient  can  be  used  only  if  it  is  the  first 
operator  or,  if  root  is  the  first  operator, 
quotient  must  be  the  next  operator.  */ 

/*  ANSWER  FOR  QUANTI TATI VE.RELATIONSHIP  */ 


nocache (answer_f or.quant i tat i ve_re lat ionship(X,Y,Z>) . 

if  quantitative< EQUATION, TERM)  =  I  RELATED, ROOT.EXPONENT, 

ROOT  EXPONENT  VALUE!  and 

convert  root.to  exponent(ROOT.EXPONENT,ROOT  EXPONENT  VALUE) 
EXPONENT.VALUE  and 

translate (CHANGE  TERM. VALUE, RELATED, EXPONENT  VALUE)  = 
CORRECT. ANSWER  and 

answers  quantitative  re lat i onsh ips ( CHANGE  TERM  VALUE, 
EXPONENT.VALUE, CORRECT.ANSWER >  =  ORDERED. ANSWERS 
then  answer. for .quant i tat i ve.re lat i onsh i p( EQUATION , TERM, 

CHANGE.TERM. VALUE)  =  [ CORRECT.ANSWER, ORDERED  ANSWERS!. 


/*  ANSWERS.QUANTI TATI VE.RELATIONSHI PS  */ 

nocache  < answer s.quant I  tat i ve.re lat i onsh ips (X, Y,Z) ) . 

if  d i f f erent.f rom-EXPONENT  VALUE  =  DISTRACTOR  NUMBER  and 

translate (CHANGE  TERM.VALUE, d irect , DISTRACTOR  NUMBER)  = 
WRONG.ANSWER  and 

order.answers ( CORRECT.ANSWER , WRONG. ANSWER)  =  ORDERED. ANSWERS 
then  answers  quant i tat i ve.re lat i onsh ips < CHANGE.TERM.VALUE, 
EXPONENT.VALUE, CORRECT.ANSWER)  =  ORDERED.ANSWERS . 


ANSWER  FOR  TERM 


/* 


nocache < answer_f or_term< X) ) . 

answer_f or_term( ' R ' )  =  range. 
answer_f or_term< ’ P( t ) ' )  =  power_transm i tted . 
answer_for_term( 'P(r) ' )  =  power_rece i ved . 
answer_f or_term< ' G ' )  =  gain. 

answer_f or_term< ' A<e ) '  )  =  e f f ect i ve_antenna_area . 
answer_f or_term( ' t(ot) ' )  =  t i me_on_target . 
answer_for_term< 'Sigma' >  =  radar_cross_sect i on . 
answer_f or_term< 'Lambda ' )  =  wavelength. 


/* 


ANSWERS_DEFINITIONS 


*  / 


nocache (answer s_de finitions(X)). 

if  answer_for_.de f  inition(A)  =  El  and 

answer_f or_de f in i t i on<B>  =  E2  and 
answer_f or_de f inition(C)  =  E3  and 
answer_f or_de f in i t ion(D)  =  E4 
then  answers_def init ions( [ A,B,C,D] )  =  [ E 1 , E2 , E3, E4 I . 


/*  ANSWERS_QUALI TATI VE_RELATIONSHI PS  */ 

answers_qual itat i ve_relat ionshipsCqual itat i ve_relat ionships)  = 

[direct, inverse , unre lated ] . 


/*  ANSWERS_TERMS  */ 

nocache (answers_terns  <  X ) ) . 

if  answer_f or_term(A)  =  El  and 
answer_f or_term( B )  =  E2  and 
answer_for_term(C)  =  E3  and 
answer_for_term(D)  =  E4 
then  answers_terms< [ A,B,C,D1 )  =  C E 1 , E2 , E3, E4 1 . 


ASK  A  QUESTION 


enumeratedanswers(ask_a_quest i on (SLIDE, ARGUMENT_LIST> ) . 


/*  DEFINITIONS  */ 

quest i on(ask_a_quest ion( definitions, [ TERM ] ) ) =  ini, 
'How  would  you  define  '.TERM,  '?']. 

automat icmenu(ask_a_quest ion(de  f ini t i ons, TERM) ) . 


/*  QUALITATIVE  RELATIONSHIP  */ 

quest i on(ask_a_quest ionfqualitati ve_re lat ionsh ips , 

[ TERM, LEFT_HAND_S IDE] ) )  =”tnl, 

'What  is  the  relationship  between  ’.LEFT  HAND  SIDE,  ’  and  ', 
TERM, 

legal val s  (ask_a_quest ionCqual itati ve_re 1  at i onsh ips , 

ARGUMENT_LIST) )  =  C d i rect , i nverse , unre lated ] . 
automat i cmenu (ask  a  quest i on(qual i tat i ve  relationships, 
ARGUMENT  LIST)). 


/*  QUANTITATIVE  RELATIONSHIPS  */ 

quest i on(ask_a_quest ion (quant itati ve.relat 1 onsh ips , 

[TERM, LEFT-HAND  SIDE, CHANGE.TERM  VALUE, 

[[ANSWER  1!REST  t ],[ ANSWER  2 ! REST  21, 

[ ANSWER.3 ! REST.3 ] , [ ANSWER_4 ! REST_4 ] 1 ] ) )  =  [nl, 

'How  does  increasing  '.TERM,  '  by  a  factor  of  ' , CHANGE_TERM_VALUE, ' 
affect  ', LEFT-HAND  SIDE.nl.nl, 

'  1.  ' .ANSWER. 1 ,nl , 

'  2.  '.ANSWER  2 , nl , 

'  3.  ' ,ANSWER_3,nl, 

’  4.  ’, ANSWER_4.nl  I . 


/*  TERMS  */ 

quest  I on(ask_a_quest i on ( terms , C  TERM ] ) ) =  [ nl , 

'What  does  the  symbol  '.TERM,  ’  represent?’]. 

automat icmenu(ask_a_quest i on ( terms , TERM) ) . 


CHECK  ANSWER 


nocache < check.answer C X , Y , Z )  is  satisfactory). 


/*  QUALTITATIVE  RELATIONSHIPS  */ 


if  NEW_STUDENT_ANSWER  ==  CORRECT.ANSWER  and 
message (conf irm.answer , CORRECT. ANSWER ) 
then  check_answer< CORRECT. ANSWER , NEW.STUDENT. ANSWER , 
qual i tat i ve.re lat i onsh ips )  is  satisfactory. 


/*  QUANTITATIVE  RELATIONSHIPS  */ 


if  NEW  STUDENT  ANSWER  ==  CORRECT  ANSWER  and 

CORRECT. ANSWER  ==  t ANSWER, RELATED, EXPONENT.VALUE ]  and 
message (conf irm  answer , ANSWER ) 
then  check .answer (CORRECT. ANSWER, NEW.STUDENT. ANSWER, 

quant i tat i ve.re lat i onsh ips )  is  satisfactory. 


/*  TERMS  */ 


if  NEW.STUDENT. ANSWER  ==  CORRECT. ANSWER  and 

message (conf irm.answer , CORRECT.ANSWER) 
then  check_answer( CORRECT.ANSWER, NEW.STUDENT. ANSWER, terms ) 
is  satisfactory. 


DEFINE  EQUATION 


de f ine.equat ion(equat ion.l )  = 

[quotient, [product, [product, 'P(t) ' , [exponent, ,G',2I1, 

[ product , (exponent , ' Lambda ' , 2 i , 'S igma ' ] ] , 
[product, [exponent, (product, 4, pi ] ,31 , 

(exponent , ' R ' , 4 ] ] ] . 


de f i ne.equat i on(equat i on_2 )  = 

(root, [quotient, [product, [product, ’P(t)' , [exponent , *G’ , 2 ] ] , 

[product, [exponent, ' Lambda ' , 2 1 , ' S igma ' J 1 
[product, [exponent, [product, 4, pi  1 , 31 , 

'P(r) ' ] 1 , 

4i  . 


de f i ne.equat i on(equat i on.3 )  = 

(root, [quotient, (product, [product, 'P(t)', Cex pone nt,'A(e)', 21 J , 

[product, 'Sigma' , 't(ot)' ] ] , 

(product, [product, 4, pi ] , 

[product, 'S' , [exponent, ' Lambda ',21]]], 

4]  . 
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/*  DIFFERENT_FROM-EXPONENT_VALUE 

nocache (d i f ferent_f rom-X) . 

if  list_of  numbers-2  =  CHOI CE_OF_NUMBERS  and 
re  move (EXPONENT  VALUE, CHOI CE_OF_NUMBERS )  = 

NEW  CHOICE  OF  NUMBERS  and 
pick (NEW  CHOICE  OF  NUMBERS)  =  DISTRACTOR.NUMBER 
then  di f ferent_from-EXP5NENT_VALUE  =  DISTRACTOR.NUMBER. 

if  list  of  numbers-2  =  CHOICE  OF  NUMBERS  and 

pick(NEW  CHOICE  OF.NUMBERS)  =  DISTRACTOR_NUMBER 
then  different  f rom-EXP5NENT  VALUE  =  DISTRACTOR_NUMBER . 


/*  LEFT_HAND_SIDE_FOR-EQUATIQN_X  i 

nocache ( le f t_hand_s ide_f or-X) . 

le f t_hand_s ide_f or-equat ion_l  =  'P(r)'. 

lef t_hand_s ide_f or-equat ion_2  =  'R*. 

le f t_hand_s ide_f or-equat ion_3  =  'R*. 


/*  LIST_OF_NUMBERS-X  i 

nocached  ist^of^numbers-X)  . 

1 ist_of_numbers- 1  =  12.0,3.0,4.0]. 
list_of  numbers-2  =  10.25,0.5,1,2,41. 


/*  MAKE_QUESTIONS  * 

nocache ( make_quest ions(SECTION, TERMS , SLIDE, NUMBER) ) . 

if  s  ingle  ..quest  ion  (SECT  I  ON,  TERMS,  SLIDE)  =  IT1SR1] 

then  make.quest ions (SECTION, TERMS, SLIDE, 1 )  =  t  T 1 ! R 1 ]  . 

if  s ingle_quest  ion  (SECT  I  ON,  TERMS,  SLIDE)  =  [THRU  and 

remove (T1 , TERMS)  =  TERMS2  and 

single  que st i on( SECTION, TERMS2 , SLIDE)  =  CT2JR2] 
then  make  ..quest  ions  (SECT  I  ON,  TERMS,  SLIDE,  2)  =  [  t  T 1  !  R  1  1 ,  t  T2  !  R2  ]  ] 

if  s ingle_quest ion(SECTION, TERMS, SLIDE)  =  IT1IR11  and 
remove(Tl .TERMS)  =  TERMS2  and 

s  ingle  ..quest  ion  (SECTION,  TERMS  2,  SLIDE)  =  [T2IR2]  and 
remove(T2,TERMS2)  =  TERMS3  and 
slngle_quest ion (SECTION, TERMS3, SLIDE)  =  tT3!R33 
then  make_quest ions(SECTION, TERMS, SLIDE, 3)  = 

’[ CTi : R 1  I , CT2IR2] , [T3!R3] ]  . 


NEW  ANSWER 


/  * 


*  / 


/*  DEFINITIONS  */ 

if  do<respt  gsk_s_que st i on(de f i n i t i ons , TERM) )  and 

ask_a_quest i on(de f i n i t i ons , TERM )  =  NEW_STUDENT_ANSWER 
then  new  answer <de f in i t i ons , N , TERM)  =  NEW_STUDENT_ANSWER . 


/*  QUALITATIVE  RELATIONSHIPS  */ 

if  do(reset  ask  a  quest ion(qual itat ive_relat ionships, 
CTERM,LEFT_HAND_SIDE3 ) )  and 
ask  a  que st i onCqual i tat i ve_re lat i onsh ips , t TERM, 
LEFT_HAND_SI DE 3 )  =  NEW_STUDENT_ ANSWER 
then  new  answer <qual i tat i ve.re lat i onsh ips , N, t TERM, 

LEFT  HAND  SIDE!)  *  NEW_STUDENT  ANSWER . 


/*  QUANTITATIVE  RELATIONSHIPS  */ 

if  doCreset  ask  a  quest i on(quant i tat i ve_re lat ionsh ips, 

t  TERM , LEFT_HAND_SI DE , CHANGE_TERM_VALUE , ANSWERS  3 ) )  and 
ask  a  quest ion(quant i tat i ve_re lat ionsh ips , t TERM, LEFT_HAND_SI DE, 
CHANGE„TERM_ VALUE, ANSWERS  3 )  =  NEW_STUDENT_ANSWER 
then  new  answer (quant i tat i ve_re lat i onsh ips ,N, [ TERM, LEFT_HAND_S IDE, 
CHANGE_TERM_VALUE , ANSWERS  3 )  =  NEW_STUDENT_ANSWER . 


/*  TERMS  */ 

if  doCreset  ask_a_quest ion(terms, TERM) )  and 

ask  a_quest ion( terms , TERM)  =  NEW_STUDENT_ANSWER 
then  new~answer <  terms , N, TERM)  =  NEW_STUDENT_ANSWER . 
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/*  NUMBER_OF_QUESTIONS  */ 

nocache <aumber_of_que st ions (SLIDE, PROFICIENCY) ) . 

number_of_quest ions( terms, bas ic)  =  3. 
number_of  ..quest i ons < terms , average )  =  2. 
number_of_questions(terms, advanced)  =  1. 

number_of  ..quest ions(def initions,bas ic)  =  3. 
number_of_quest ions(def init ions, average)  =  2. 
number_of_quest i ons(de f in i t i ons , advanced)  =  1. 

number_of_quest ions(qual itati ve_re!ationships, basic)  =  2. 
number_of_quest i ons (qual i tat i ve_re lat i onsh ips , average )  =  1. 
number_of_quest ions(qual i tat i ve_relat i onships, advanced)  =  1. 

number_of_quest i ons (quant i tat i ve_re lat ionships, bas ic)  =  2. 
number_of_quest ions(quant itat i ve_relat ionships, average)  =  1. 
number_of_quest ions (quant itati ve_re lat i onsh i ps , advanced)  =  1 . 


/*  ORDER..  ANSWERS  */ 

nocache (order_answers(X,  Y)  ) . 

if  CORRECT  ANSWER  ==  [ RIGHT.CHANGE, RELATED, EXPONENT  VALUE]  and 
convert.re lat i onsh ip(RELATED)  =  INVERTED.RELATIONSHIP  and 
round_nu»ber(( 1  /  RIGHT_CHANGE> , 3)  =  INVERSE  RIGHT_CHANGE  and 
DISTRACTOR  2  ==  [  INVERSE  _RIGHT..CHANGE,  INVERTED  RELATIONSHIP, 
EXPONENT  VALUE]  and 

WRONG_ ANSWER  ==  [WRONG  CHANGE, d irect , WRONG  EXPONENT_VALUE ]  and 
round_number ( ( 1  /  WRONG  CHANGE), 3)  =  INVERSE  WRONG„CHANGE  and 
DISTRACTOR_4  ==  [ I NVERSE_WRONG_CHANGE, inverse , 
WRONG_EXPONENT_VALUE ]  and 

put  direct  answer  f irst< CORRECT  ANSWER, DISTRACTOR  2)  = 

[  ANSWER..  1 ,  ANSWER_2  ]  and 
random( 4)  =  RANDOM.NUMBER  and 

scramble -RANDOM  NUMBER-f or- C ANSWER  1, ANSWER  2, WRONG  ANSWER, 
DISTRACTOR_4 ]  =  ANSWERS 

then  order_answers(CORRECT_ANSWER, WRONG  ANSWER)  =  ANSWERS. 


/*  PUT_DI  RECT_.FI  RST  */ 

nocache (put_d ire ct_ans we r_f irst (X, Y) ) . 

if  CORRECT_ANSWER  ==  [ RIGHT_CHANGE, d irect , EXPONENT_VALUE ] 
then  put_direct  answer_f  irst  ( CORRECT.. ANSWER, DISTRACTOR  2)  = 

[ CORRECT_ANSWER, DISTRACTOR_2 ] . 

if  CORRECT.ANSWER  ==  ( RIGHT.CHANGE, inverse ,EXPONENT_VALUEJ 
then  put_dlrect_answer_f Irst ( CORRECT_ANSWER, DISTRACTOR_2 )  = 

[ DISTRACTOR_2 , CORRECT. ANSWER ] . 
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QUANTITATIVE 


/* 


*/ 


nocache  (quantitative(X,Y)) . 

if  def ine .equat ion (EQUATION)  =  [quot ient, NUMERATOR, DENOMINATOR] 

and 

contains (NUMERATOR, TERM)  =  [ ROOT_EXPONENT, ROOT.EXPONENT.VALUE ] 
then  quant itat i ve (EQUATION, TERM)  =  [ d i rect , ROOT.EXPONENT, 
ROOT.EXPONENT.VALUE) . 

if  de  f ine. equat ion (EQUATION)  =  [quot ient, NUMERATOR, DENOMINATOR) 

and 

con ta i ns ( DENOM I NATOR , TERM  >  =  t RQOT_EXPONENT , RQOT_EXPONENT_VALUE J 
then  quant itat i ve (EQUATION, TERM)  =  [ i nverse , ROOT.EXPONENT, 
ROOT.EXPONENT.VALUE) . 

if  def ine_equat ion(EQUATION)  =  C root ,[ quot ient , NUMERATOR, 
DENOMINATOR] ,ROOT_VALUE]  and 

con tains (NUMERATOR, TERM)  =  C ROOT.EXPONENT, 

ROOT  EXPONENT  VALUE]  and 

comb i ne ( roo  t , ROOT.VALUE , ROOT_EXPONENT , ROOT.EXPONENT.VALUE )  = 

[ POWER.ROOT , POWER.ROOT.V ALUE ] 
then  quantitative(EQUATION,TERM>  =  t d i rect , POWER.ROOT, 

POWER.ROOT. VALUE ] . 

if  define  equat ion(EQUATION)  =  t root ,[ quot ient , NUMERATOR, 
DENOMINATOR], ROOT  VALUE]  and 

con ta ins (DENOM I NATOR, TERM)  =  I ROOT.EXPONENT , 

ROOT  EXPONENT  VALUE]  and 

combine (root, ROOT  VALUE, ROOT  EXPONENT , ROOT.EXPONENT.VALUE )  = 

[ POWER.ROOT , POWER_ROOT_ VALUE ] 

then  quantitati ve(EQUATION, TERM)  =  [ i nverse , ROOT_EXPONENT, 
POWER^ROOT_VALUE] . 

if  def ine_equation(EQUATION>  =  [ FIRST_OPERATOR, FI RST_ARGUMENT, 

SECOND  ARGUMENT]  and 

conta ins(FIRST_ARGUMENT, TERM)  =  ISECOND_OPERATOR, SECOND. VALUE] 
and 

comb i ne ( FI RST  ARGUMENT , SECOND.ARGUMENT , SECOND.OPERATOR , 

SECOND  VALUE)  =  [ NEW. OPERATOR , NEW. VALUE  1 
then  quantitati ve (EQUATION, TERM)  =  [direct, NEW.OPERATOR , NEW. VALUE ] . 

if  def ine .equat ion (EQUAT I ON)  =  [ F I RST.OPERATOR, FI RST. ARGUMENT, 

SECOND  ARGUMENT]  and 

conta ins(SECOND.ARGUMENT, TERM)  =  [SECOND.OPERATOR, 

SECOND  VALUE]  and 

comb i ne ( FI RST.OPERATOR , SECOND.ARGUMENT , SECOND.OPERATOR , 

SECOND  VALUE)  =  [ NEW.OPERATOR, NEW.VALUEJ 
then  quantitative! EQUATION, TERM)  =  [ d i rect , NEW.OPERATOR, NEW.VALUE ] . 

if  de f ine .equat l on (EQUAT I ON)  =  EXPRESSION  and 

conta i ns ( EXPRESSION , TERM )  =  [ OPERATOR, VALUE ] 
then  quantitative(EQUATION, TERM)  =  [ d i rect , OPERATOR, VALUE  1 . 


QUIZ_STUDENT 


/* 


*  / 


nocache  <qu i z_student (SECTION , TERMS, SLI DE) ) . 

if  student_mode 1 -SLIDE  =  PROFICIENCY  and 

number_of_questions(SLIDE, PROFICIENCY)  =  NUMBER.OF.QUESTIONS 
and 

make  quest ions<SECTION, TERMS, SLIDE, NUMBER  OF  QUESTIONS)  = 
LIST_OF_QUESTIONS  and 

each-ask_quest ion-of-LIST_OF_QUESTIONS-of-SLIDE  is  complete 
and 

student_mode l_updated(SLIDE)  is  sought  and 
do<reset  ask_a_quest i on(SLIDE,QUESTION_ARGUMENTS) )  and 
do (re set  new~answer (SLIDE, N,QUESTION_ARGUMENTS) )  and 
do (re set  number_of _correct_answers (SLIDE) ) 
then  quiz_student(SECTION, TERMS, SLIDE) . 


/* 


SCRAMBLE 


*/ 


nocache (scramble-X-f or-Y) . 


scramble- 1-foi — [ ANS  1,ANS  2,ANS  3,ANS_43  = 
[ ANS_ 1 , ANS_3, ANS_2 , ANS_  4 ] . 

scramble-2-f or-[ ANS  1,ANS_2,ANS  3, ANS  41  = 
[ ANS_3, ANS_ 1 , ANS_4» ANS_2 ] . 


scramble-3-for-tANS.l,ANS.2,ANS_3,ANS_4]  = 
[ANS_4,ANS_2,ANS_l,ANS_33 . 


scramble -4- for- C  ANS_ 1 , ANS_2 , ANS_3 , ANS_4  3  = 
CANS  2, ANS_4, ANS_3, ANS  1 3 . 


SINGLE-ASK  QUESTION-OF-LIST-OF-SLIDE 


/* 


*  / 


nocache ( s ingle-ask_quest i on-o f-ARGUMENT_LIST-of -SLIDE  is  complete). 
noautomaticquestion(single-ask_questi on- of -ARGUMENT_LI ST-o  f -SLI DE 
is  complete). 


/*  DEFINITIONS  */ 

if  do(addz  temp_l ist: legal val s (ask_a_quest i on(de f init ions, 
[TERM]))  =  ORDERED,ANSWERS)  and 
ask_a  quest ion(def init ions, [TERM] )  =  STUDENT_ANSWER  and 
STUDENT, ANSWER  ==  CORRECT_ANSWER  and 
message (conf irm_answer, CORRECT_ANSWER) 
then  s ingle-ask_quest ion-of-[ TERM, CORRECT_ANSWER, 

ORDERED_ANSWERS ] -of-de f in i t i ons  is  complete. 

if  ask_a_quest ion(de f in i t ions ,[ TERM J )  =  STUDENT, ANSWER  and 

no tlsTUDENT, ANSWER  ==  CORRECT, ANSWER)  and 
tutor ing(TERM, CORRECT_ANSWER, STUDENT_ANSWER, terms )  is 
satisfactory 

then  s ingle-ask_quest ion-of- 1  TERM, CORRECT_ANSWER, 

ORDERED,ANSWERSl -of-de f init ions  is  complete. 

i f  message ( te 1 l,answer , CORRECT_ANSWER) 

then  s ingle -ask,quest ion-of- [ TERM, CORRECT,ANSWER, 

ORDERED_ANSWERS ] -of-de f init ions  is  complete. 


/*  QUALITATIVE  RELATIONSHIPS  */ 

if  ask  a  quest ion<qual i tat  i  ve  relationships, 

7tERM,LEFT,HAND_SIDE3 )  =  STUDENT,ANSWER  and 
STUDENT, ANSWER  ==  CORRECT_ANSWER  and 
message (conf irm,answer , CORRECT,ANSWER) 
then  s ingle-ask_quest i on-o f- [ TERM, LEFT,HAND,S IDE, CORRECT, ANSWER, 

ORDERED_ANSWERS ] -of-qual itat i ve_relat ionships  is  complete 

if  ask  a  quest ionCqual i tat  i  ve  relationships, 

[TERM,LEFT_HAND_SIDE] )  =  STUDENT  ANSWER  and 
no t < STUDENT.ANSWER  ==  CORRECT_ANSWER )  and 

t  u  t or i ng  <  TERM , LEFT_HAND_S I DE , CORRECT, ANSWER , STUDENT, ANSWER , 
qual itative_relationships)  is  satisfactory 
then  single-ask,quest ion-of- l TERM, LEFT_HAND_S IDE, CORRECT, ANSWER, 

ORDERED_ANSWERS ] -of -qual i tat i ve_re lat  ionsh  ips  is  complete 

i  f  message (te 1 l_answer, CORRECT, ANSWER) 

then  single-ask_quest ion-of- [TERM, LEFT_HAND_SIDE,CORRECT,ANSWER, 

ORDERED_ANSWERS ] -of -qual i tat i ve_re lat i onsh ips  is  complete 


/*  QUANTITATIVE  RELATIONSHIPS  */ 


if  doCaddz  te mp_l i st : legal val s (ask_a_quest i on 

(quantitati ve_re lat i onsh i ps , t  TERM , LEFT_HAND_SI DE, 
CHANGE_TERM_VALUE , ORDERED_ANSWERS 3  ) )  =  ORDERED, ANSWERS) 
and 

ask  a  quest ion(quant i tat i ve  re lat i onsh ips , [ TERM, LEFT_HAND_SI DE, 
CHANGE  TERM_VALUE , ORDERED_ANSWERS ] )  =  STUDENT, ANSWER  and 
STUDENT  ANSWER  ==  CORRECT  ANSWER  and 

CORRECTlANSWER  ==  [ANSWER, RELATED, EXPONENT_VALUE 1  and 
message (conf irm  answer, ANSWER) 

then  single -ask  quest i on-o f- [ TERM, LEFT_HAND,SI DE, CHANGE,TERM_VALUE, 
CORRECT, ANSWER , ORDERED, ANSWERS ]  -of- 
quant i tat i ve_re lat i onsh i ps  is  complete. 

if  ask  a  question(quantitative_relationships, [ TERM, LEFT_HAND,S IDE, 
CHANGE  TERM_VALUE,ORDERED_ANSWERS] )  =  STUDENT, ANSWER  and 
not (STUDENT~ANSWER  ==  CORRECT  ANSWER)  and 

t  u  t  or i ng ( TERM , LEFT_HAND_S I DE , CHANGE, TERM_VALUE , CORRECT.ANSWER , 
STUDENT,ANSWER , ORDERED.ANSWERS , quant i tat i ve_re 1 at i onsh i ps ) 
is  satisfactory 

then  single-ask  quest ion-of- t TERM, LEFT  HAND_SIDE, CHANGE,TERM_VALUE, 
CORRECT, ANSWER , ORDERED, ANSWERS 1-of- 
quantitative_relationships  is  complete. 

if  CORRECT,ANSWER  ==  [ANSWER, RELATED, EXPONENT, VALUE  1  and 
me ssage < te 1 1, answer, ANSWER) 

then  single-ask  quest i on-o f - [ TERM , LEFT_HAND_SI DE , CHANGE, TERM_VALUE , 
CORRECT,ANSWER, ORDERED, ANSWERS] -of - 
quantitative,relationships  is  complete. 


/*  TERMS  */ 

if  dofaddz  temp  1 i st : legal val s <ask_a_quest i onC terms ,[ TERM ]) )  = 
ORDEREDlANSWERS)  and 

ask  a  quest ionCterms, [TERM] >  =  STUDENT_ANSWER  and 
STUDENT, ANSWER  ==  CORRECT, ANSWER  and 
message  <  conf i rm,answer , CORRECT, ANSWER) 
then  single-ask_question-of-[TERM, CORRECT, ANSWER, 
ORDERED_ANSWERS]-of-terms  is  complete. 

if  ask  a  quest ion( terms ,[ TERM ] )  =  STUDENT_ANSWER  and 
not (STUDENT  ANSWER  ==  CORRECT, ANSWER )  and 
tutor i ng< TERM, CORRECT_ANSWER,STUDENT_ANSWER, terms) 
is  satisfactory 

then  single-ask,question-of-t TERM, CORRECT, ANSWER, 

ORDERiD_ANSWERS ] -of-terms  is  complete. 

i f  message (tel l_answer, CORRECT_ANSWER) 
then  single-ask_question-of-[ TERM, CORRECT, ANSWER , 
ORDERED_ANSWERS] -of-terms  is  complete. 
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SINGLE  QUESTION 


/* 


nocache (single_question< SECTION, TERMS, SLIDE) ) . 


*/ 


/*  DEFINITIONS  */ 

if  multipick ( TERMS, 4)  =  LIST.OF.TERMS  and 

answers.de f i n i t i ons (LIST.OF.TERMS )  =  ANSWERS  and 
p ick (LI ST.OF.TERMS)  =  TERM  and 

answer_for.de f i n i t ion( TERM )  =  CORRECT.ANSWER  and 
di splay ( C nl ,nl , ' I  * * m  still  work ing nl , nl  ] ) 
then  s ingle_quest i onCSECTION , TERMS , de f in i t i ons )  = 

[ TERM , CORRECT_ANSWER , ANSWERS  1 . 


/*  QUALITATIVE  RELATIONSHIPS  */ 
if  pick (TERMS)  =  TERM  and 

answers  qual i  tat  i  ve.re lat i onsh ips (qual i tat i ve_re lat i onsh i ps ) 
ANSWERS  and 

answer_for  qual i tat i ve_re lat i onsh ips(SECTION, TERM)  = 
c5rRECT  ANSWER  and 

lef t.hand.s ide.f or-SECTION  =  LEFT.HAND.SIDE  and 
display( ini ,nl , *  I ’ 'm  still  work ing nl , nl 1 ) 
then  single  quest  1  on (SECTION , TERMS, qual i tat i ve.re lat i onsh ips )  = 

I  TERM , LEFT.HAND.S I DE , CORRECT. ANSWER , ANSWERS ] . 


/*  QUANTITATIVE  RELATIONSHIPS  */ 

if  pick (TERMS)  =  TERM  and 

list  of.numbers-1  =  CHOI CE.OF.NUMBERS  and 
pick(CHOICE.OF.NUMBERS)  =  CHANGE. TERM. VALUE  and 
answer  for  quantitative  relat ionship(SECTION, TERM, 

CHANGE  TERM_VALUE)”=  C CORRECT.ANSWER, ANSWERS J  and 
left.hand.slde.f or-SECTION  =  LEFT.HAND.SIDE  and 
display( tnl ,nl , ' I ' 'm  still  work Ing. ' ,nl ,nl 1 ) 
then  single  quest ion(SECTION, TERMS, quant i tat ive. re lat i onsh ips )  = 
t  TERM, LEFT  HAND  SIDE, CHANGE.TERM.VALUE, 

CORRECT  ANSWER , ANSWERS ] . 


/*  TERMS  */ 

if  mul t ip ick( TERMS, 4)  =  LI ST.OF.TERMS  and 

answers. terms(LIST.OF.TERMS)  =  ANSWERS  and 
pick (LIST  OF  TERMS)  =  TERM  and 
answer. for.term(TERM)  =  CORRECT.ANSWER  and 
display( tnl ,nl , ' I  * 'm  still  work ing nl , nl ] ) 
then  single  quest ion(SECTION, TERMS, terms)  = 

C TERM , CORRECT.ANSWER , ANSWERS ) . 


SINGLE-SECTION  TYPE-OF-SECTION-OF-LESSON 


nocache ( s  ingle-sect i on_type-o f-SECTION-of-LESSON  Is  complete) 

if  si ides(LESSON, SECTION)  =  LIST_OF_SLIDES  and 

each-sl ide_type-of-LIST_OF_SL7DES-of-SECTION  is  complete 
then  s ingle-sect ion_type-of-SECTION-of-LESSON  is  complete. 


/*  SINGLE-SLIDE.TYPE-OF-SLIDE-OF-SECTION 

nocache(single-sl ide_type-of-SLIDE-of-SECTION  is  complete). 

if  symbols(SECTION, SLIDE)  =  TERMS  and 

mater ial (SECTION, SLIDE)  is  presented  and 
message (pat ience ,tl )  and 

qu iz_student(SECTION, TERMS, SLIDE)  is  sought 
then  single -si ide_type-of-SLIDE-of -SECTION  is  complete. 

if  mater ial (SECTION, SLIDE)  is  presented 

then  s ingle-sl ide_type-of-SLIDE-of -SECTION  is  complete. 


/*  SYMBOLS 

nocache (symbol s(SECTION,SL IDE) ) . 

noautomat icquest ion (symbols (SECTION, SLIDE) > . 

if  symbols_for-SECTION(terms>  =  TERMS 
then  symbol s (SECTION, de f in i t i onl )  =  TERMS. 

if  symbols_for-SECTION(equat ions)  =  TERMS 

then  symbol s (SECTION, qual i tat i ve_re lat i onsh ips )  =  TERMS. 

if  symbols_for-SECTION(equat ions)  =  TERMS 

then  symbol s(SECTION, quant i tat i ve_re lat lonsh ips )  =  TERMS. 

if  symbo 1 s_f or-SECTION( terms )  =  TERMS 
then  symbols(SECTION, terms )  =  TERMS. 
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SYMBOLS  FOR-SECTI ON 


/  * 

nocache (symbol s_f or -SECT I ON (SLIDE) ) . 
symbols_for — equation_l(equations)  = 


[  'P(t) ’ , 

'R' , 

'G', 

’ Sigma ' , 

' Lambda  ' ] 


symbo 1 s_f or-equat i on_2 (equat i ons )  =  I 


symbol s_f or-equat ion_3(equat ions )  = 


'P(r) ' , 
'P(t) ' , 
'G'  , 

'Sigma' > 

' Lambda '  ] 

[ 'P(r) ' , 
'P(t) ' , 
'A(e) ' , 
't(ot) ' , 
'Sigma' , 
'Lambda' J 


symbol s_f or-equat i on_ 1 ( terms )  = 


symbol s_f or-equat ion_3( terms)  = 


[ ’P(r)' , 
'P(t)', 
'R', 

'G' » 

'Sigma' , 
'Lambda' ] 

[ 'P(r) ' , 
'P(t)'  , 
'R', 
'A(e)’, 
't(ot) ' , 
'Sigma' , 
'Lambda' ] 


/* 


TERM  FOR  ANSWER 


*/ 


*/ 


Erf 


nocache ( term_for_answer ( X ) ) . 
term_for_answer(range )  =  'R'. 

term_f or_answer(power_transm l tted)  =  'P(t)'. 
term_for_answer(power_rece i ved)  =  'P(r)'. 
term_f or_answer(ga in)  =  'G'. 

term_for_answer(ef fective_antenna_area)  =  'A(e)'. 
term_f or_answer ( t i me_on_targe t )  =  't(ot)'. 
term_f or_answer ( radar_cross_sect ion)  =  'Sigma'. 
term_for_answer<wavelength)  *  'Lambda'. 


R> 


/*  QUIZZING  KNOWLEDGE  BASE  */ 

/*  STUDENT  MODEL-X  */ 


/*  This  is  part  of  the  QUIZZING-KB.  */ 


/*  DEFINITIONS  */ 

quest i on< student_mode 1 -de f initio ns )=  tnl ,nl , 
'Can  you  define  these  terms? 

1 .  No . 

2 .  I ' ' m  not  sure . 

3.  Yes. ’ 1 . 


/*  EQUATIONS  */ 

quest i on( student^mode 1 -equat i ons ) =  [ nl ,nl , 

'Are  you  familiar  with  the  radar  range  equation? 

1.  I  don''t  know  what  it  is. 

2 .  I ’ ' ve  heard  of  it. 

3 .  I ' ' ve  used  it.']. 


/*  QUALITATIVE  RELATIONSHIPS  */ 
if  student_model-equat ions  =  PROFICIENCY 

then  student_mode 1 -qual i tat i ve_re lat ionships  =  PROFICIENCY. 


/*  QUANTITATIVE  RELATIONSHPS  */ 
if  student_mode 1 -equat l ons  =  PROFICIENCY 

then  student_model -quant i tat i ve_re lat i onsh ips  =  PROFICIENCY. 
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/*  TERMS  */ 

quest  ion  (student  ..model-  terms  )=  ini  ,  nl , 

'How  familiar  are  you  with  the  terms,  such  as  effective  antenna 
area  and  wavelength,  and  the  symbols  associated  with  them? 

1.  I''m  not  familiar  with  them. 

2.  I"m  comfortable  with  them. 

3.  I''m  very  familiar  with  them.']. 


legalvals<student_model-AREA>  =  [basic, average, advanced] 
enumeratedanswers<  student _mode 1 -AREA ) . 
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STUDENT  MODEL  KNOWLEDGE  BASE 


I N I TI AL_STUDENT_MODEL 


nocache ( in i t ial  student  model). 


then 


message  <explain_student_model, [ ])  and 
student_mode 1 -terms  is  sought  and 
student_mode 1 -de f in i t i ons  is  sought  and 
student_mode 1 -equat i ons  is  sought 
initial  student  model. 


/*  STUDENT_MODEL_UPDATED  * 

nocache(student_mode l_upda ted (SLIDE) ) . 

if  student_mode 1 -SLIDE  =  average  and 

number_of_quest ions(SLIDE, average)  =  QUESTIONS_ASKED  and 
number  of  correct  answers (SLIDE, QUESTIONS_ASKED>  = 
QUESTIONS  CORRECT  and 

score ( QUEST I ONS_ ASKED, QUEST I ONS_CORRECT>  =  low  and 
do(set  student_mode 1 -SLIDE  =  basic) 
then  student_model_updated(SLIDE> . 

if  student_mode 1 -SLIDE  =  advanced  and 

number_of_quest ions(SLIDE, advanced)  =  QUESTIONS_ASKED  and 
number_of_correct_answers  (SLIDE, QUESTIONS.. ASKED)  = 
QUESTIQNS_CORRECT  and 

score ( QUEST I ONS_ ASKED, QUEST I ONS_ CORRECT)  =  low  and 
do(set  student^mode 1 -SLIDE  =  average) 
then  student_model_updated(SLIDE) . 

if  student_mode 1 -SLIDE  =  basic  and 

number_of_quest ions(SLIDE,bas ic)  =  QUESTIONS_ASKED  and 
number  of  correct_answers(SLIDE,QUESTIONS_ASKED)  = 
QUESTIONS_c5RRECT  and 

score ( QUESTI ONS_ASKED , QUESTI  ONS..CORRECT )  =  high  and 
do(set  student_mode 1 -SLIDE  =  average) 
then  student_mode l_updated(SLIDE) . 

if  student_mode 1 -SLIDE  =  average  and 

number_of_questions(SLIDE, average)  =  QUESTIONS_ASKED  and 
number  of  correct_answers(SLIDE,QUESTIONS_ASKED)  = 
QUESTIONS  CORRECT  and 

score  (QUESTIONS.. ASKED , QUESTIONS., CORRECT)  =  high  and 
do(set  student_mode 1 -SLIDE  =  advanced) 
then  student_mode l_updated(SLIDE) . 

student  model  updated(SLIDE) . 


/* 

/* 

/* 


TUTOR  KNOWLEDGE  BASE 


*  / 
*/ 
*/ 


/*  TUTOR  */ 

nocache ( tutor ( APPROACH, PROFICIENCY, TUTOR  CYCLE) ) . 


/*  QUALITATIVE  RELATIONSHIP  */ 

/*  BASIC  */ 

if  message ( in_denominator_bas ic  for  qualitative  relationship, 
TERM)' 

then  tutor < TERM- in_de nominator- for_qual i tat i ve_re lat i onsh ip, 
bas ic, N)  . 

if  message < in_numerator  basic  f or_qual i tat i ve  relationship, 
TERM)' 

then  tutor (TERM- in_numerator-f or_qual i tat i ve_relat i onsh ip, 
bas ic, N)  . 

/*  AVERAGE  */ 

if  message< in_denominator_average_for_qual itative  relationship, 
TERM) 

then  tutor(TERM- in_denom inator-f or_qual i tat i ve_re lat i onsh i p , 
average , N ) . 

if  message ( in_numerator  average_for  qualitative  relationship, 
TERM) 

then  tutor ( TERM- in_numerator- f or_qual i tat i ve_re lat i onsh i p, 
average , N) . 
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/*  QUANTITATIVE  RELATIONSHIP  */ 


/*  BASIC  */ 

if  message (both  wrong  basic  for  quantitative  relationship, 

I  TERM , RELATED , LEFT_HAND_SI DE , FACTOR ] ) 

then  tutor< TERM- i s-RELATED- 1 o -LEFT_HAND_SI DE-by-FACTOR- 
for_quant i tat i ve_relat ionship.bas ic,N) . 

if  message ( factor_bas ic_for_quant itat i ve_relat ionship, 

I  TERM , FACTOR , LEFT_HAND_S IDE]) 

then  tutor (FACTOR-f or-TERM-f or  quantitative  relationship  with- 
LEFT_HAND_SI DE , bas i c7N ) . 

if  message( in_denominator  basic  for  quantitative  relationship, 
t TERM , LEFT_HAND_S I DE 1 ) 

then  tutor (TERM- in  denominator-f or_quant i tat i ve_relat ionship_with- 
LEFT_HAND_SIDE, bas ic, N) . 

if  message(in  numerator_bas ic  for_quantitati ve  relationship, 

[  TERM7LEFT-HAND_>S  IDE]) 

then  tutor (TERM- in  numerator-f or  quant i tat i ve.re lat i onsh ip  with- 
LEFT_HAND_SIDE,bas  ic,N) . 

/*  AVERAGE  */ 

i f  message (bo th_wrong_average_f or_quant I  tat i ve_relat i onsh ip, 

[ TERM , RELATED , LEFT_HAND_S I DE , FACTOR ] ) 

then  tu tor ( TERM- i s-RELATED- to-LEFT_HAND_SI DE-by-FACTOR- 
f or.quant i tat i ve_re lat i onsh ip, average , N ) . 

if  message (factor  average  for  quantitative  relationship, 

[ TERM , FACTOR , LEFtIhAND_S IDE!) 

then  tutor(FACTOR-f or-TERM-for  quantitative  relationship  with- 
LEFT_HAND_SIDE, average, N) . 

i f  message ( in^denom inator_average_f or_quant i tat i ve_re lat i onsh ip, 

t  TERM , LEFT_HAND_S IDE]) 

then  tutor (TERM- ln_denom inator-f or_quant i tat ive_re lat i onsh ip_wi th- 
LEFT_HAND_SIDE, average ,N) . 

i  f  message  ( i  n_riumerator_average_f  or_quant  i  tat  i  ve_re lat  i  onsh  ip, 

[ TERM , LEFT_HAND_S IDE]) 

then  tutor(TERM-in  numerator-f or  quantitative  relationship  with- 
LEFT_HAND_SIDE, average, N) . 

if  message(unrelated,TERM) 

then  tutor(TERM-unre lated, ANY_PROFICIENCY,N) . 
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/*  TERM  */ 


i f  message  <de  f ine.bas ic, STUDENT.ANSWER) 
then  tutor<def ine -STUDENT. ANSWER, bas ic,  N) 


i  f  message  (def  ine  ..average  , STUDENT.ANSWER) 
then  tutor(def i ne -STUDENT. ANSWER, average, N) 


/*  ADVANCED  STUDENT  */ 


if  message(try.again, t 3 ) 
then  tutor (ANY.SLIDE, advanced, N> 


TUTOR-CYCLE-N-OF- (T, C , S, SL) 


nocache (tutor-cycle-N-of-(W,X, Y,Z)  is  complete), 
nocache ( tutor-cycle-N-of - (V,W, X, Y,Z)  is  complete). 
nocache(tutor-cycle-N-of-(U, V,W,X, Y,Z)  is  complete). 


/*  DEFINITIONS  */ 


if  N  >=  3  and 

me  s  sage  (  te 1 1  ans  we r , CORRECT. ANSWER ) 
then  t  u  t or-cycl e -N-o  f - ( AN Y.TERM , CORRECT.ANSWER , AN Y.STUDENT.ANSWER , 
definitions)  is  complete. 


if  d i agno  s i s  <  TERM , CORRECT.ANSWER , STUDENT. ANSWER , de  f i n i t i ons , N )  = 

PROBLEM  and 

student  mode 1-de f ini t ions  =  PROFICIENCY  and 
metatutor( PROBLEM , STUDENT. ANSWER , N )  =  APPROACH  and 
tutor (APPROACH, PROFICIENCY, N)  and 
N  +  l  =  M  and 

number  of  wrong  answers(M)  is  sought  and 

new  answer (def init ions,M, ITERM J )  =  NEW.STUDENT.ANSWER  and 
check.answer ( CORRECT.ANSWER , NEW.STUDENT.ANSWER , de  f i n i t i ons ) 
is  satisfactory 

then  tutor-cycle -N-o f - < TERM , CORRECT.ANSWER , STODENT.ANSWER , 
definitions)  is  complete. 


if  N  <  3  and 

N  +  1  =  M  and 

new  answer (def init ions,M, (TERM! )  =  NEW.STUDENT.ANSWER  and 
tutor-cycle-M-of- (TERM, CORRECT.ANSWER, NEW.STUDENT.ANSWER, 
definitions)  is  complete 

then  tutor-cycle-N-of - ( TERM , CORRECT.ANSWER , STUDENT.ANSWER , 
definitions)  is  complete. 
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/*  QUALITATIVE  RELATIONSHIPS  */ 


if  N  >=  2  and 

message  (  te 1 l_answer, CORRECT  ANSWER) 
then  tu tor-cycle -N-o f- ( ANY.TERM, LEFT_HAND_SIDE, CORRECT.ANSWER, 

ANY, STUDENT, ANSWER, qual i tat i ve_re lat i onsh ips )  i s 
complete. 

if  d i agnos i s  <  TERM , CORRECT, ANSWER , STUDENT_ANSWER , 

qual itative_relationships,N>  =  PROBLEM  and 
student_model-qual i tat i ve  relationships  =  PROFICIENCY  and 
metatutor(TERM, PROBLEM, CORRECT,ANSWER,N>  =  APPROACH  and 
tu t or ( APPROACH, PROFICIENCY, N)  and 
N  +  1  =  M  and 

number_of_wrong_answers(M)  is  sought  and 

new,answer(qual itat i ve,relat ionships,M, CTERM,LEFT  HAND  SIDE!) 
NEW,STUDENT, ANSWER  and 

check, answe  r  <  CORRECT.ANSWER , NEW_STUDENT,ANSWER , 
qual itative_relationships)  is  satisfactory 
then  tut or-cyc le-N-of- (TERM, LEFT, HAND_SIDE, CORRECT„ANSWER, 

STUDENT,ANSWER,qual itative_relationships)  is  complete. 


if  N  <  2  and 

N  +  1  =  M  and 

nev,answer (qual  i  tat  i  ve,relat  i onsh  ips ,  M,  [  TERM,LEFT,HAND  SIDED  = 
NEW  STUDENT.ANSWER  and 

tutor-cycle-M-of-( TERM , LEFT,HAND„S I DE , CORRECT, ANSWER , 

NEW,STUDENT,ANSWER,  qualitative  relat i onsh ips )  is  complete 
then  tutor ~cycle-N-of-( TERM , LEFT,H AND,S IDE, CORRECT, ANSWER , 

STUDENT, ANSWER, qual i tat i ve,re lat ionsh ips)  is  complete. 
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/*  QUANTITATIVE  RELATIONSHIPS  */ 
if  N  >=  2  and 

CORRECT_ANSWER  ==  [ANSWER, RELATED, EXPONENT]  and 
message(tell  answer, ANSWER) 

then  tuto* — cycle-N-of -( ANY  TERM, LEFT.HAND.SIDE, CHANGE.TERM.VALUE, 
CORRECT.ANSWER , AN Y.STUDENT.ANSWER , ORDERED.ANSWERS , 
quantitative_relationships)  is  complete. 

if  d i agno  s i s  <  TERM , CORRECT. ANSWER , STUDENT.ANSWER , 

quantitative_relationships,N>  =  PROBLEM  and 
student  mode  1 -quant i tat i ve. re lat ionsh ips  =  PROFICIENCY  and 
me  tat u  tor  < TERM , PROBLEM , LEFT.HAND.S I DE , CORRECT.ANSWER , N)  = 
APPROACH  and 

tutor (APPROACH, PROFICIENCY , N)  and 
N  +  1  =  M  and 

number.of.wrong.answers(M)  is  sought  and 

ne w.answer <  quant i tat i ve_re 1 a  t i onsh i ps , M , t  TERM , LEFT.HAND.SIDE, 
CHANGE.TERM. VALUE , ORDERED.ANSWERS ] )  =  NEW.STUDENT. ANSWER 
and 

check.answer (CORRECT.ANSWER, NEW.STUDENT.ANSWER, 
quantitative  relationships)  is  satisfactory 
then  tutor-cycle-N-of-(TERM,LEFT_HAND.SIDE,CHANGE.TERM_VALUE, 
CORRECT. ANSWER , STUDENT.ANSWER , ORDERED. ANSWERS , 
quant i tat i ve.re lat i onsh ips )  is  complete. 

if  N  <  2  and 

N  +  1  =  M  and 

new  answer(quantitative  relationships^,  [TERM, LEFT.HAND.S IDE, 
CHANGE.TERM.VALUE, ORDERED.ANSWERS 1 )  =  NEW.STUDENT.ANSWER 
and 

tutoi — cycle-M-of-( TERM , LEFT  HAND.S I DE , CHANGE. TERM. VALUE , 
CORRECT.ANSWER , NEW.STUDENT.ANSWER , ORDERED.ANSWERS , 
quantitative  relationships)  is  complete 
then  tutor-cycle-N-of-(TERM,LEFT  HAND_SIDE,CHANGE.TERM.VALUE, 
CORRECT.ANSWER , STUDENT. ANSWER , ORDERED.ANSWERS , 
quantitative  relationships)  is  complete. 


/*  TERMS  */ 


if  N  >=  3  and 

message (tell .answe r , CORRECT.ANSWER ) 
then  tutor-cycle-N-of-(ANY_TERM, CORRECT.ANSWER, ANY.STUDENT.ANSWER, 
terms)  Is  complete. 

if  d  i  agnos  i  s  ( TERM ,  CORRECT.,  ANSWER ,  STUDENT  ANSWER,  terms ,  N>  = 

PROBLEM  and 

student.model-terms  =  PROFICIENCY  and 
metatutor(PROBLEM, STUDENT  ANSWER, N>  =  APPROACH  and 
t u  t or <  APPROACH , PROF I C I ENC Y , N )  and 
N  +  1  =  M  and 

number.of.wrong.answers(M)  is  sought  and 
new.answer<  terms , M, I  TERM ] )  =  NEW.STUDENT.ANSWER  and 
check.answer ( CORRECT.ANSWER , NEW.STUDENT.ANSWER , terms ) 
is  satisfactory 

then  tu tor-cycl e-N-of - < TERM , CORRECT. ANSWER , STUDENT.ANSWER , 

terms)  is  complete. 


if  N  <  3  and 

N  +  1  =  M  and 

new.answer < terms, M, ITERM] )  =  NEW.STUDENT.ANSWER  and 
t  u  t or-cyc 1 e -M-o  f - <  TERM , CORRECT.ANSWER , NEW.STUDENT.ANSWER , 

terms)  is  complete 

then  t u t or-cyc 1 e -N-o f - < TERM , CORRECT.ANSWER , STUDENT.ANSWER , 

terms)  is  complete. 


/*  TUTORING  */ 

nocache(tutoring(W,X,Y,Z)  is  satisfactory), 
nocache < tutor ing(V,W,X, Y,Z)  is  satisfactory). 
nocache(tutor ing(U,V,W,X, Y,Z)  is  satisfactory). 


/*  QUALITATIVE  RELATIONSHIPS  */ 

if  tu tor-cycle- 1 -of -( TERM, LEFT_HAND_SIDE,CORRECT_ANSWER, 

STUDENT_ANSWER,qual i tat i ve.re lat ionsh ips)  is  complete 
then  tutoring < TERM , LEFT.HAND.S I DE , CORRECT. ANSWER , STUDENT. ANSWER , 
qual i tat i ve.relat i onsh ips)  is  satisfactory. 


/*  QUANTITATIVE  RELATIONSHIPS  */ 

if  tutor -eye le-l-of-< TERM , LEFT.HAND.S I DE , CHANGE. TERM  VALUE, 

CORRECT. ANSWER , STUDENT. ANSWER , ORDERED. ANSWERS , 
quant i tat l ve.relat lonships)  is  complete 
then  tu  tor i ng  <  TERM , LEFT.HAND.S I DE , CHANGE  TERM.VALUE, CORRECT  ANSWER, 
STUDENT. ANSWER , ORDERED. ANSWERS , 
quantltatlve.relationships)  is  satisfactory. 


I 
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/*  MISCELLANEOUS  FUNCTIONS  KNOWLEDGE  BASE  */ 


/*  ADVANCE  */ 

nocache (advance ) . 

quest ionCadvance )  =  [nl,nl,  'Please  type  ''c'*  to  continue.'!. 
legalvals(advance)  =  Ic!. 

/*  COMBINE  */ 

nocache < comb ine < W, X, Y, 2) ) . 

combine (product , ANY.EXPRESS I ON, SECOND  OPERATOR, SECOND  VALUE)  = 

C  SECOND_OPERATOR , SECOND.VALUE ] . 

combine ( sum, ANY.EXPRESS I ON , SECOND  OPERATOR, SECOND  VALUE)  = 

[ SECOND_OPERATOR , SECOND. VALUE  1 . 

comb ine ( d i f fere nee , ANY.EXPRESS I ON, SECOND  OPERATOR, SECOND  VALUE)  = 
[ SECOND.OPERATOR , SECOND.VALUE ] . 

if  FIRST.OPERATOR  ==  SECOND  OPERATOR  and 
FIRST. VALUE  *  SECOND. VALUE  =  NEW  VALUE 
then  combine (FIRST.OPERATOR, FIRST  VALUE, SECOND  OPERATOR, 

SECOND. VALUE)  =  [ FIRST.OPERATOR, NEW. VALUE  1 . 

if  EXPONENT.VALUE  =<  ROOT.VALUE  and 

EXPONENT.VALUE  /  ROOT.VALUE  =  NEW.VALUE 
then  comb ine (exponent, EXPONENT.VALUE, root, ROOT.VALUE)  = 

[ exponent, NEW.VALUE  J 7 

if  EXPONENT.VALUE  >=  ROOT  VALUE  and 

EXPONENT.VALUE  /  ROOT.VALUE  =  NEW.VALUE 
then  combine(root, ROOT.VALUE, exponent, EXPONENT.VALUE)  = 

[exponent, NEW.VALUE!  . 

if  EXPONENT.VALUE  >=  ROOT.VALUE  and 

EXPONENT.VALUE  /  ROOT.VALUE  =  NEW.VALUE 
then  combine(exponent, EXPONENT  VALUE, root , ROOT  VALUE)  = 

[exponent , NEW.VALUE ! 7 

if  EXPONENT.VALUE  =<  ROOT.VALUE  and 

EXPONENT.VALUE  /  ROOT.VALUE  =  NEW.VALUE 
then  combine(root,ROOT  VALUE, exponent, EXPONENT  VALUE)  = 

(exponent, NEW.VALUE! . 


B 


CONTAINS 


/* 


*/ 


noautomaticquestion(contains(X,Y)). 
nocache (contains(X,Y)) . 

conta ins ([ exponent , TERM, EXPONENT! , TERM)  =  [exponent, EXPONENT] . 
contains( [root, TERM, ROOT] )  =  (root, ROOT]. 

containsC (OPERATOR, TERM, ANY  EXPRESSION] , TERM)  =  [ e xponent , 1 ] . 
contains( [OPERATOR, ANY.EXPRESSION, TERM] , TERM)  =  (exponent,]]. 

if  LIST  ==  (HEAD! TAIL]  and 

conta ins (LIST, TERM)  =  [SECOND_OPERATOR,SECOND_VALUEl  and 
comb i ne  ( FI RST.OPERATOR , FI RST.VALUE , SECOND_OPERATOR, 

SECOND. VALUE)  =  NEW.VALUES 

then  contains< (FIRST  OPERATOR , LIST, FIRST.VALUE ], TERM)  = 
NEW.VALUES . 

if  conta insCREST  OF  EXPRESSION, TERM)  =  VALUES 

then  conta i ns  < [ OPERATOR , AN Y.EXPRESS I ON , REST.OF.EXPRESSI ON ] , TERM ) 
VALUES. 


/*  CONTAINS. QUAL  */ 

noautomat icquest ion(contains.qual (X, Y) ) . 
nocache (conta ins.qual (X, Y) ) . 

contains  qual ([ TERM ! TAIL  1, TERM) . 

con ta i ns  qual ( [ OPERATOR , TERM , AN Y.EXPRESSI ON ] , TERM ) . 
con  ta i ns.qua 1 ( [ OPERATOR , ANY. EXPRESS I ON , TERM ] , TERM ) . 

if  contains  qual ( [HEAD ! TAIL  1 , TERM) 

then  conta ins.quaK (OPERATOR, ( HEAD \ TAIL  1 , ANY.EXPRESSION ] , TERM) . 
if  contains  qual ( (HEAD! TAIL] , TERM) 

then  containsIquaK [OPERATOR, ANY.EXPRESSION, [HEADJTAIL] ] , TERM) . 


/*  CONVERT.RELATIONSHIP  */ 

nocache (con vert.re lat ionship(X) ) . 

convert. re lat i onsh i p(d irect )  =  inverse, 
convert. relat ionship( inverse )  =  direct. 


I 

. 

\  /*  CONVERT_ROOT_TO„EXPONENT  */ 

! 

i  nocache<convert_root„_to_exponent<X, Y) > • 

if  ROOT_EXPONENT  ==  root  and 
'  1  /  ROOT_EXPONENT_VALUE  =  EXPONENT.. VALUE 

|  then  convert  root  to_exponent(ROOT  EXPONENT, 

ROOT_EXPONENT_VALUE )  =  EXPONENT, VALUE. 

if  not <ROOT_EXPONENT  ==  root) 

|  then  convert  root  to„exponent (ROOT  EXPONENT, 

R05t  EXPONENT  VALUE)  =  ROOTEXPONENT  VALUE. 


/*  EACH-TYPE-OF-ELEMENT-OF-WHOLE  */ 

nocache<each-TYPE-of-ELEMENT-of-WHOLE  is  complete). 

each-TYPE-of-l 1-of-WHOLE  is  complete. 

if  single-TYPE-of-ELEMENT-of-WHOLE  is  complete  and 
each-TYPE-of-TAIL-of-WHOLE  is  complete 
then  each-TYPE-of-tELEMENT!TAILl-of-WHOLE  is  complete. 

if  s ingle-TYPE-of-ELEMENT-of-WHOLE  is  complete 
then  each-TYPE-of-ELEMENT-of-WHOLE  is  complete. 


/*  FlNISHED„WITH,LESSON  */ 

if  displayftnl, 

*1  hope  this  has  been  helpful.’  ,nl3) 
then  f inished„wi th, lesson. 


/*  LENGTH  */ 

nocache  < length(X) ) . 

length< l 1 )  =  0. 
length<  t  A  3  )  =  1  . 
length< C A,B3 )  =  2. 
length< t A,B,C1 )  =  3. 
length< C A,B,C,D1 )  =  4. 

if  iength(TAIL)  =  M  and 
M  +  4  =  N 

then  lengthf  [A,B,C,D.'TAIL3 )  =  N. 
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if  presentat ion(SECTION, SLIDE)  =  P  and 
display(P)  and 
advance  is  sought 

then  mater ial (SECTION, SLIDE)  is  presented. 


/*  MESSAGE  */ 

nocache (message (ID, LI ST_OF_ARGUMENTS) ) . 

if  term_for_answer(STUDENT_ANSWER>  =  A  and 
di splay ( C nl , 

'No,  ' ,STUDENT_ANSWER, ’  is  represented  by  ’,A,’.  Remember 
that  with  many  terms,  you  can  use  a  neumonic  dev  ice . ' ,nl J ) 
then  message (de f ine_bas ic, STUDENT_ ANSWER) . 

if  term^f or_answer(STUDENT_ANSWER)  =  A  and 
dispiay( Cnl , 

'No,  ' ,STUDENT_ANSWER, '  is  represented  by  ',A,'.',nlJ) 
then  message (de f ine_average ,STUDENT_ANSWER> . 


if  message  text(ID,LIST  0F_ ARGUMENTS )  =  TEXT_OF_MESSAGE  and 
display?  TEXT  J3F_MESSAGE ) 
then  message ( ID, LIST  OF_ARGUMENTS) . 


/*  MESSAGE_TEXT  */ 

nocache ( me  ssage.te  x t ( ANYID , ANY_LIST_OF_ARGUMENTS ) ) . 

message_text(conf irm_answer,CORRECT_ANSWER)  =  Cnl, 

'Your  answer  of  '  , CORRECT_ANSWER,  '  is  correct.'  ,nl]. 

message_text (expla in.student^mode 1 , C I )  =  Cnl, 

'I  will  ask  you  a  couple  of  questions  to  help  me  better  direct 
th i s  lesson . ' 1 . 

message_text(patience, [ ] )  =  Cnl, 

'Please  be  patient  while  I  make  up  some  questions.'  ,nll. 

message_text  ( tel  l_answer,  CORRECT..  ANSWER)  =  Cnl, 

'The  correct  answer  is  ' ,CORRECT_ANSWER,  '.'  ,nll. 

message_text(try_again, C 1 )  =  Cnl, 

'Your  answer  is  incorrect .’, nl ] . 


/*  QUALITATIVE  RELATIONSHIPS  */ 

/ *  BAS  I C  * / 

message_text < in_numerator  bas ic_f or_qual i tat i ve_re lat ionsh ip, 
TERM>”=  Ini, 

TERM,'  is  in  the  numerator  which  means  it  is  not  inversely 
re lated . ’ , nl 1 . 

message  text < in_denom inator_bas ic_f or_qual i tat i ve_re lat i onsh ip, 
TERM)  =  Ini, 

TERM,  '  is  in  the  denominator  which  means  it  is  not  directly 
re lated . ' ,nl ] . 

/*  AVERAGE  */ 

message_text  C in_numerator_average_f or_qual i tat i ve_re lat i onsh ip, 
TERM)~=  Ini, 

'No,  ',TERM,  ’  is  in  the  numerator .', nl ] . 

message  text ( in_denom inator_average  f or_qual i tat i ve_re lat ionsh ip 
TERM)  =  Cnl, 

'No,  ’,TERM,  '  is  in  the  denom i nator . ' , nl ] . 

message_text(unrelated,TERM>  =  tnl, 

'No,  ',TERM,  '  is  not  in  this  equat i on . ’ , nl 1 . 


/*  QUANTITATIVE  RELATIONSHIPS  */ 
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/ *  BAS  I C  * / 

me  ssage_te  xt ( i n_numerator_bas ic_f  or_quant i tat i ve_re lationship, 
[TERm7lEFT_HANdIsIDE]7  =  Tnl, 

'You  have  the  correct  power  but  the  wrong  relationship  between  ’,nl 
LEFT_HAND_SIDE, '  and  '.TERM,'.  '.TERM,'  is  in  the  numerator  and 
directly  related  to  * , LEFT_HAND_SIDE,  '.'.nil. 

me s sage _ text ( i n_denom i nator„bas ic_f or_quant itat i ve_relat ionship, 
CTERM,LEFT_HAND_SIDE] )“  =  tnl, 

'You  have  the  correct  power  but  the  wrong  relationship  between  ',nl 
LEFT_HAND_SIDE, '  and  ' , TERM , ' -  ' , TERM, '  is  in  the  denominator  and 

inversely  related  to  ' ,LEFT_HAND_SIDE,  '.'.nil. 

message  text(both  wrong_bas i c_f or_quant i tat i ve_re lat i onsh i p, 

“ [ TERM, RELATED , LEFT_HAND_s7DE , FACTOR ] )  =  tnl, 

'Both  the  power  and  the  relationship  between  ' ,LEFT_HAND_SIDE,nl , 

'  and  ' , TERM , '  are  incorrect.  'LEFT_HAND_SIDE, '  is  ', 

RELATED, 'ly  related  to  ',TERM,  '  by  a  power  of  ', FACTOR, nl 1 . 

me s sage _ text ( factor_bas ic_f or_quant i tat i ve_re lationship, 
t TERM, FACTOR, LEFT_HAND_SIDEJ >  =  Tnl, 

'You  have  the  correct  relationship  between  ’ , LEFT_HAND_SIDE, '  and  ' 
TERM,'  but  the  incorrect  power.  The  power  is  ' , FACTOR, ’ . ' ,nl ] . 


/*  AVERAGE  */ 

message  textCin  numerator  average  f or_quant i tat i ve_re lat i onsh i p, 
[TERM,LEFT_HAND_SIDE])  =  tnl, 

'No,  '.TERM,  '  is  in  the  numerator nl ] . 

me s sage _ text ( in_denom i nator_a verage_f or_quant itative_re lationship, 
[ TERM , LEFT_HAND_SI DE ] )  =  tnl, 

'No,  '.TERM,  '  is  in  the  denom i nator . ' , nl 1  . 

message_text ( unre lated, TERM )  =  tnl, 

'No,  ’.TERM,  ’  is  not  in  this  equat i on . ’ , nl  1  . 

me s sage _ text (both_wrong_a verage_f  or_quant i tat i ve_re lationship, 
“[TERM, RELATED, LEFT  HANDlsiDE, FACTOR  1)  =  Tnl, 

'No,  ’ , LEFT_HAND_SI DE ,  '  is  ’.RELATED,  'ly  related  to  '.TERM,'  by 
a  power  of  ',  FACTOR,  '.’.nil. 

message_te  xt ( f act or_ave rage _f or_quant itative_relationship, 

[TERM, FACTOR, LEFtIhAND.SIDEI )  =  CnT, 

'No,  the  factor  for  ’.TERM,  '  is  ’ .FACTOR, ’.' ,nlJ . 
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MULTIPICK 


/* 


nocache (multipick <X,Y)). 

if  length(LIST)  =  LENGTH  and 

multipickKLIST, NUMBER, LENGTH)  =  RESULT 
then  multipick(LIST, NUMBER)  =  RESULT. 


/*  MULTIPICK1 

nocache (mul t ipick 1 (X, Y,Z) ) . 
mul  t  ip  ick  1  ( ANY_LIST, 0,  ANYNUMBER)  =  M. 
if  NUMBER  >=  LENGTH 

then  multipickKLIST, NUMBER, LENGTH)  =  LIST. 

if  LENGTH  -  NUMBER  =  DIFFERENCE  and 
DIFFERENCE  <  NUMBER  and 
remv-DIFFERENCE-from-LIST  =  NEW.LIST 
then  multipickKLIST, NUMBER. LENGTH)  =  NEW_LIST. 

if  pick(LIST)  =  ELEMENT  and 

re move (ELEMENT, LI ST)  =  NEW.LIST  and 
NUMBER  -  1  =  NEW  NUMBER  and 
LENGTH  -  1  =  NEW.LENGTH  and 

mul  tip  ick  KNEW  LIST,  NEW_NUMBER ,  NEW_LENGTH  )  =  Tfl 
then  multipickKLIST, NUMBER, LENGTH)  =  [ELEMENT! TAIL! 


/*  NTH_TERM 

nocache (nth_term(X, Y) ) . 

nth_term(  1 ,  [  A'.Bl  )  =  A. 
nth_term(2, t A,B! Cl )  =  B. 
nth_term( 3, [ A, B, C ! D 1 >  =  C. 
nth_term( 4, [ A, B, C, D I E 1 )  =  D. 

if  NUMBER  -  4  =  SMALLER.NUMBER  and 

nth_term(SMALLER_NUMBER, REST_OF_LIST>  =  TERM 
then  nth_term(NUMBER,7A,B,C,D!REST_0F_LISTi >  =  TERM. 


/*  NUMBER_OF_CORRECT_ANSWERS  */ 

nocache (number_o  f ,correct_answers (SLIDE, QUESTIONS_ASKED_ ) ) . 

if  number  wrong  =  QUESTIONS.. WRONG  and 

QUESTl5NS_ASKED  -  QUEST I ONS_ WRONG  =  QUESTIONS..CORRECT  and 
do(reset  number_wrong) 

then  number  of_correct_answers(SLIDE,QUESTIONS_ASKED)  = 
QUESTIONS_CORRECT . 

number  of  correct_answers(SLIDE,QUESTIONS_ASKED>  = 

“questions.asked. 


/*  NUMBER_OF_WRONG_ANSWERS  */ 

nocache(number_of..wrong<_answers<ANY_.NUMBER) )  . 

if  number_wrong  is  unknown  and 
do(set  number_wrong  =  1) 
then  number..of_wrong_answers<  2  > . 

if  number  wrong  =  NUMBER..  INCORRECT  and 

NUMBERllNCORRECT  +  1  =  UPDATED_NUMBER_I NCORRECT  and 
do(set  number_wrong  =  UPDATED_NUMBER_INCORRECT) 
then  number_of_wrong_answers<2) . 

number_of..wrong..answers<  ANYNUMBER) . 


/*  NUMBER_WRONG  */ 

noautomat icquest ion(number_wrong) . 


/*  PICK  */ 

nocache <  p i ck  <  X ) ) . 

if  lengthCLIST)  =  NUMBER  and 

random (NUMBER)  =  RANDOM_NUMBER  and 
nth_term(RANDOM_NUMBER, LIST)  =  TERM 
then  pick(LIST)  =  TERM. 


POWER 


/* 


nocache<power<CHANGE_TERM_VALUE,POWER_VALUE) ) . 


*/ 


power  <CHANGE_TERM_VALUE,  1  )  =  CHANGE.TERM.VALUE . 

if  POWER_VALUE  -  1  =  NEW  POWER  VALUE  and 

power (CHANGE_TERM  VALUE, NEW  POWER. VALUE)  =  RESULT  and 
CHANGE.TERM  VALUE  *  RESULT  =  RELATIONSHIP 
then  power <CHANGE_TERM  VALUE, POWER  VALUE)  =  RELATIONSHIP. 


/*  RANDOM  */ 

nocache (random(X) ) . 
if  seed  -  SEED  and 

(SEED  mod  MAXIMUM.VALUE)  +  1  =  RANDOM.NUMBER  and 
do<reset  seed)  and 

<125  *  SEED  +  1)  mod  4096  =  NEW.SEED  and 
do(set  seed  »  NEW  SEED) 
then  random < MAXI MUM.VALUE)  =  RANDOM.NUMBER . 
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RELATED 


/* 


*/ 


nocache (related(X,Y)) . 

if  re  la ted (EXPRESS I ON, TERM)  =  RELATIONSHIP 

then  related( [root, EXPRESSION, ROOT! , TERM)  =  RELATIONSHIP. 

if  re  la ted (EXPRESS I ON, TERM)  =  RELATIONSHIP 

then  related( [exponent, EXPRESSION, EXPONENT] , TERM)  =  RELATIONSHIP 
if  conta ins_qual (NUMERATOR, TERM) 

then  re lated( Tquo t ient .NUMERATOR, DENOMINATOR  1 , TERM)  =  direct, 
if  contains  qual (DENOMINATOR, TERM) 

then  re lated( Tquot ient , NUMERATOR , DENOMINATOR ] , TERM)  =  inverse. 

if  (contains_qual (FACTOR1 ,TERM)  or 
contains_qual (FACTOR2 , TERM) > 
then  related( [sum, FACTOR  1 ,FACTOR21 , TERM)  =  direct. 

if  (conta ins_qual (FACTOR  1 , TERM)  or 
conta ins_qual (FACTOR2 , TERM) ) 

then  related( (difference, FACTOR1 ,FACTOR2J , TERM)  =  direct. 

if  (contains_qual (FACTOR1 ,TERM)  or 
conta ins_qual (FACTOR2, TERM) ) 
then  re lated( [product, FACTOR  1 ,FACTOR21 , TERM)  =  direct. 

re lated(EQUATIQN, TERM)  =  unrelated. 


/*  REMOVE  */ 

nocache (remove (X, Y)  )  . 

remove (A, [ ] )  *  [ 1 . 
remove (A, ( A ! TAIL ] )  =  TAIL, 
remove (B, (A, B! TAIL] )  =  (AiTAILJ. 
remove(C, [A,B,C!TAIL] )  =  [A, BITAIL] . 
remove(D, [ A,B,C,D! TAIL! )  =  [ A,B, C ! TAIL] . 

if  remove(TERM, TERMS  IN  LIST)  =  NEW_LIST 
then  remove ( TERM, [ A , B, C, D ! TERMS_IN_LIST] )  = 


[  A , B , C , D ! NEW_LI ST ] . 


REMV-N-FROM-LIST 


/* 


*/ 


nocache (remv-NUMBER- from-LIST)  . 

if  p ick(LIST)  =  ELEMENT  and 

remove (ELEMENT, LI ST)  =  NEW.LIST 
then  remv- 1-from-LIST  =  NEW.LIST. 

if  NUMBER  -  1  *  NEW.NUMBER  and 

re *v-NEW_NUMBER- from-LIST  =  LIST1  and 
pick(LISTl)  *  ELEMENT  and 
re move (ELEMENT, LI ST1)  =  RESULT 
then  remv-NUMBER-f rom-LIST  =  RESULT. 


/*  ROOT  */ 

nocache ( root ( CHANGE.TERM.VALUE, ROOT.VALUE) ) . 

root (CHANGE.TERM.VALUE, 1 .0)  =  CHANGE.TERM.VALUE. 

if  float (CHANGE  TERM.VALUE)  =  REAL. CHANGE.TERM.VALUE  and 
ROOT  VALUE  *  2  =  NEW  ROOT.VALUE  and 
root (REAL  CHANGE  TERM.VALUE , NEW.ROOT.VALUE >  = 

INTERMEDIATE  RESULT  and 
sqrt(INTERMEDIATE.RESULT)  =  CHANGE 
then  root (CHANGE  TERM  VALUE, ROOT. VALUE)  *  CHANGE. 


/*  ROUND.NUMBER  */ 

nocache (round.number (X, Y) ) . 

if  powerC 10, PLACES)  =  FACTOR  and 

real .round (NUMBER  *  FACTOR)  /  FACTOR  =  RESULT 
then  round  number(NUMBER, PLACES)  =  RESULT. 


SCORE 


i 


a 


a 


nocache ( score  (QUESTIONS_ASKED , QUESTIONS.CORRECT > ) . 


if  QUESTIONS  CORRECT /QUEST I ONS.ASKED  =  PERCENT_CORRECT  and 
PERCENT..CORRECT  <  0.5 

then  score (QUEST I ONS_ASKED, QUEST I 0NS_C0RRECT)  =  low. 


if  QUESTIONS_CORRECT/QUESTIONS_ASKED  *  PERCENT_CORRECT  and 
PERCENT_C5RRECT  >=  0.5  and 
PERCENT_CORRECT  =<  0.75 

then  score (QUEST I ONS_ ASKED, QUEST I ONS_CORRECT)  =  medium. 


if  QUESTI ONS_CORRECT /QUESTI ONS_ASKED  =  PERCENT_CORRECT  and 

PERCENT.CORRECT  >  0.75 

then  score  (QUESTIONS_ASKED,  QUESTIONS..  CORRECT)  =  high. 


SEED 


quest ion(seed)  =  Ini,  'Please  enter  the  day  of  the  month, 
instance  if  this  is  the  May  15,  enter  ''15".' 1. 


legal vals(seed)  =  integer. 
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TRANSLATE 


I 


nocache ( translate (X, Y,Z) ) . 

if  EXPONENT  VALUE  <  1.0  and 

root(CHANGE_TERM_VALUE,EXPONENT_VALUE)  =  CHANGE  and 
round.number< CHANGE, 3)  =  ROUNDED  CHANGE 
then  translate(CHANGE_TERM  VALUE, direct, EXPONENT  VALUE)  = 
t  ROUNDED  ..CHANGE  .direct,  EXPONENT.VALUE  1 7 

if  EXPONENT_VALUE  <  1.0  and 

root  < CHANGE.TERM  VALUE, EXPONENT  VALUE)  =  CHANGE  and 
1 /CHANGE  =  INVERSE.CHANGE  and 

round_number( INVERSE.CHANGE, 3)  =  I NVERSE.ROUNDED  CHANGE 
then  translate (CHANGE.TERM.VALUE,  inverse, EXPONENT.VALUE)  == 
1INVERSE.R0UNDED.CHANGE, inverse .EXPONENT.VALUE] . 

if  EXPONENT.VALUE  >=  1.0  and 

power (CHANGE.TERM.VALUE, EXPONENT.VALUE)  =  CHANGE  and 
round. number(CHANGE, 3)  =  ROUNDED.CHANGE 
then  translate (CHANGE  TERM  VALUE, direct, EXPONENT  VALUE)  = 

( ROUNDED.CHANGE .direct, EXPONENT.VALUE 1 7 

if  EXPONENT.VALUE  >=  1.0  and 

power (CHANGE.TERM.VALUE, EXPONENT  VALUE)  =  CHANGE  and 
1 /CHANGE  =  I N VERSE.CHANGE  and 

round.number< INVERSE. CHANGE, 3)  *  I NVERSE.ROUNDED. CHANGE 
then  translate(CHANGE.TERM_VALUE, inverse, EXPONENT  VALUE)  * 
t I NVERSE.ROUNDED  CHANGE, in verse, EXPONENT  VALUE! . 


/  /  «*  / 


IvH 


/*  =========== 

/*  =========== 

/* 

/*  =========== 


LISTING  OF  RULES 


==========  */ 

==========  */ 

*  / 

==========  */ 


/*  Control  Rules  Knowledge  Base 


Lesson 

Lesson_complete 


Diagnostics  Knowledge  Base 
D  iagnos i s 


Lesson  Knowledge  Base 


Presentat ion 


Metatutor  Knowledge  Base 
Metatutor 


Presentation  Knowledge  Base 

Sections 
SI  ides 
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Question  Generator  and  Solver  Knowledge  Base 


Answer_f or_de f in i 1 1  on 

Answer_f or_qual itat i ve_relat ionships 

Answer_f or_quant i tat i ve_re lat ionsh ip 

Answers_quant i tat i ve_re 1  at i onsh ips 

Answer_ for- term 

Answers_de  f in i t i ons 

Answers_qual itat lve.rel at ionships 

Answers_terms 

Ask_a_quest ion 

Check_answer 

De  f  ine_equat ion 

Di  f ferent_from_e xponent_ value 

Le  f  t_hand_s ide_f or_equat i on_x 

L  i  st_of_numbers_x 

Make_quest ions 

New_answer 

Number_of_quest ions 

Order_answers 

Put_direct_f irst 

Quant i tat i ve 

Qu  iz_student 

Scramble 

Single_ask-quest ion-of-1 ist-of-slide 
S ingle_quest ion 

S ingle_sect ion_type-of-sect ion-of -lesson 
Single-sl ide_type-of-sl ide-of-sect ion 
Symbols 

Symbol s_f or_sect ion 
Term_f or_answer 


Quizzing  Knowledge  Base 


Student_mode 1  -  x 


Student  Model  Knowledge  Base 


In  it ial_student_model 
Student_mode l_updated 


Tutoring  Knowledge  Base 


Tutor 

Tutor-cycle-n-of-1 1st 
Tutoring 


Miscellaneous  Functions  Knowledge  Base 

Advance 

Combine 

Contains 

Conta ins_qual 

Convert_re lat 1 onsh i p 

Convert_root_to_exponent 

Each- type -of -e lement-of -whole 

F in  1 shed_w i th_lesson 

Length 

Material 

Message 

Message_text 

Multipick 

Mu  1 1 ip ick  1 

Nth_ter» 

Number_of _correct_answers 

Number_of_wrong_answers 

Number_wrong 

Pick 

Power 

Random 

Related 

Remove 

Remv-n-from-1 1st 
Root 

Round_number 

Score 

Seed 

Translate 
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